Oct 30 20:36:02.812250 ip-10-0-131-162 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 20:36:02.812262 ip-10-0-131-162 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 20:36:02.812269 ip-10-0-131-162 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 20:36:02.812573 ip-10-0-131-162 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 20:36:14.332950 ip-10-0-131-162 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 20:36:14.332963 ip-10-0-131-162 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8383a4c717c040f2b96cc59012eb6993 --
Oct 30 20:38:37.240329 ip-10-0-131-162 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:38:37.652037 ip-10-0-131-162 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:37.652037 ip-10-0-131-162 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:38:37.652037 ip-10-0-131-162 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:37.652037 ip-10-0-131-162 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:38:37.655411 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655330    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:37.655411 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655410    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:37.655411 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655414    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655418    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655421    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655424    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655427    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655430    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655433    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655435    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655438    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655441    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655443    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655446    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655450    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655453    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655455    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655458    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655461    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655464    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655474    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655477    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:37.655504 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655480    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655483    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655485    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655488    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655490    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655493    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655496    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655499    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655501    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655504    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655507    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655510    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655513    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655515    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655519    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655521    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655524    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655526    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655529    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:37.655955 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655532    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655535    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655539    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655541    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655544    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655546    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655549    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655551    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655554    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655556    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655558    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655561    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655564    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655566    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655569    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655572    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655575    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655579    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:37.656418 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655583    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655586    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655589    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655592    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655595    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655598    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655600    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655603    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655606    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655608    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655611    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655613    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655616    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655618    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655621    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655626    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655629    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655633    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655636    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:37.656837 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655639    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655642    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655644    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655648    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655651    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655653    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655656    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655658    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655661    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655664    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655666    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655669    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655671    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655674    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655677    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655680    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655683    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655685    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655688    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655690    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:37.657299 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655693    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655696    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655698    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655701    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655703    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655706    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655708    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.655711    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656529    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656537    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656540    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656545    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656549    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656552    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656554    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656557    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656560    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656563    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656566    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656568    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:37.657802 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656572    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656575    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656577    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656580    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656583    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656586    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656589    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656591    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656594    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656596    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656599    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656602    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656604    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656607    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656609    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656612    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656615    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656618    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656620    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656623    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:37.658281 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656625    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656628    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656631    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656634    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656637    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656640    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656643    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656645    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656648    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656651    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656653    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656656    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656658    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656661    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656664    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656666    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656670    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656673    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656676    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656679    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:37.658770 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656681    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656684    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656687    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656689    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656692    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656695    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656697    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656700    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656703    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656706    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656709    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656712    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656716    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656719    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656722    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656724    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656727    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656730    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656733    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:37.659266 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656736    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656738    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656741    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656743    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656746    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656749    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656751    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656754    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656756    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656759    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656762    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656765    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656767    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656770    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656773    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656776    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656778    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656781    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656783    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656786    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:37.659718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656788    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656791    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656794    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656796    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656799    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656802    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656804    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656807    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656809    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656812    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656815    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656818    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656821    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656825    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.656827    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657319    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657325    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657327    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657331    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657333    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:37.660200 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657336    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657339    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657342    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657344    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657347    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657350    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657352    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657355    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657358    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657361    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657364    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657366    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657369    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657372    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657375    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657377    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657380    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657383    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657385    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:37.660671 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657388    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657390    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657393    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657395    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657398    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657401    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657403    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657406    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657408    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657411    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657413    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657415    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657418    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657420    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657423    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657425    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657428    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657430    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657435    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657438    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:37.661150 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657440    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657443    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657446    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657448    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657451    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657454    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657456    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657459    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657462    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657464    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657467    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657469    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657471    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657474    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657477    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657479    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657481    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657485    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657487    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657490    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:37.661706 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657492    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657495    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657497    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657500    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657502    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657505    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657507    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657510    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657513    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657516    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657521    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657524    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657527    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657531    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657534    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657537    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657540    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657543    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657545    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657548    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:37.662211 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657550    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657553    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657555    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657559    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657563    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657566    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657568    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657571    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657573    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657576    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657580    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657582    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657585    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657588    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657590    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657593    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657595    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657598    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657601    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:37.662683 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657604    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657608    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.657611    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658759    2586 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658769    2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658778    2586 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658783    2586 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658788    2586 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658791    2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658796    2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658800    2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658803    2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658808    2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658811    2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658815    2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658818    2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658821    2586 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658824    2586 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658827    2586 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658830    2586 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658833    2586 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658838    2586 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658841    2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:38:37.663167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658844    2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658848    2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658851    2586 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658856    2586 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658859    2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658862    2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658865    2586 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658868    2586 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658871    2586 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658874    2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658879    2586 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658882    2586 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658887    2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658890    2586 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658893    2586 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658896    2586 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658899    2586 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658902    2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658906    2586 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658910    2586 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658913    2586 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658916    2586 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658919    2586 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658923    2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:38:37.663702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658926    2586 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658929    2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658932    2586 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658935    2586 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658938    2586 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658941    2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658946    2586 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658948    2586 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658951    2586 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658955    2586 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658959    2586 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658962    2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658966    2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658969    2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658972    2586 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658975    2586 flags.go:64] FLAG: --help="false"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658978    2586 flags.go:64] FLAG: --hostname-override="ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658981    2586 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658986    2586 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658989    2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658992    2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658996    2586 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.658999    2586 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:38:37.664302 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659002    2586 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659005    2586 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659008    2586 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659011    2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659015    2586 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659017    2586 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659031    2586 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659034    2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659037    2586 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659040    2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659043    2586 flags.go:64] FLAG: --lock-file=""
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659046    2586 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659049    2586 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659052    2586 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659058    2586 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659062    2586 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659065    2586 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659068    2586 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659071    2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659074    2586 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659078    2586 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659081    2586 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659085    2586 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659088    2586 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659092    2586 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:38:37.664843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659096    2586 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659099    2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659103    2586 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659107    2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659110    2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659113    2586 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659116    2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659122    2586 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659125    2586 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659128    2586 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659132    2586 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659135    2586 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659138    2586 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659141    2586 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659144    2586 flags.go:64] FLAG: --port="10250"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659147    2586 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659150    2586 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-09b15f447c87517aa"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659159    2586 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659163    2586 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659167    2586 flags.go:64] FLAG: --register-node="true"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659170    2586 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659174    2586 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659176    2586 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659179    2586 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659182    2586 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659186    2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:38:37.665463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659189    2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659192    2586 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659195    2586 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659198    2586 flags.go:64] FLAG: --runonce="false"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659201    2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659204    2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659207    2586 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659210    2586 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659215    2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659218    2586 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659221    2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659224    2586 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659227    2586 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659230    2586 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659232    2586 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659235    2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659238    2586 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659241    2586 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659244    2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659250    2586 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659253    2586 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659256    2586 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659261    2586 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659264    2586 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659267    2586 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:38:37.666153 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659270    2586 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659273    2586 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659276    2586 flags.go:64] FLAG: --v="2"
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659281    2586 flags.go:64] FLAG: --version="false"
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659285    2586 flags.go:64] FLAG: --vmodule=""
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659289    2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659292    2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659443    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659447    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659451    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659455    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659459    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659464    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659468    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659470    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659474    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659477    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659480    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659482    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659485    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659488    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:37.666724 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659490    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659493    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659495    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659498    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659501    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659503    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659506    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659509    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659511    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659514    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659516    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659519    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659521    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659524    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659527    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659529    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659532    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659534    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659537    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659539    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:37.667237 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659543    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659546    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659549    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659552    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659555    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659557    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659560    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659563    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659565    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659568    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659570    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659573    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659576    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659579    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659581    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659584    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659586    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659589    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659591    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659594    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:37.667714 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659597    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659599    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659602    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659604    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659607    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659609    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659612    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659615    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659617    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659620    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659622    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659625    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659629    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659631    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659634    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659637    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659640    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659643    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659645    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:37.668190 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659648    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659650    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659653    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659655    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659658    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659661    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659663    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659666    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659668    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659671    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659673    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659676    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659679    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659682    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659684    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659687    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659690    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659692    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659695    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:37.668636 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659698    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659700    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659703    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659706    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659708    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659711    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659714    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659717    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659720    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659723    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659727    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659731    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659734    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659737    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.659761    2586 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659797    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:37.669112 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659801    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659804    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659807    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659810    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659812    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659815    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659818    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659820    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659823    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659826    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659830    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659832    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659835    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659838    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659841    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659843    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659846    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659849    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659852    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:37.669727 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659854    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659857    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659860    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659862    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659866    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659869    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659872    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659874    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659877    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659880    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659884    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659888    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659891    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659894    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659897    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659900    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659902    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659905    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659910    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:37.670353 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659914    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659917    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659919    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659922    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659926    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659929    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659931    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659934    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659936    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659939    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659942    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659944    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659947    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659949    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659952    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659954    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659957    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659961    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659963    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659966    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:37.670810 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659968    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659971    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659974    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659977    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659979    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659982    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659985    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659987    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659990    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659992    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659995    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.659999    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660001    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660004    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660007    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660009    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660013    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660016    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660029    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660032    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:37.671363 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660035    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660038    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660040    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660043    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660046    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660048    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660051    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660054    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660056    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660060    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660063    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660065    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660068    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660071    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660073    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660076    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660079    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660082    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660084    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:37.671856 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660087    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660090    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660092    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660095    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660097    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660100    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660103    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.660106    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.666988    2586 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.667003    2586 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.667031    2586 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.667038    2586 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667107    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667114    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667117    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667121    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667124    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667127    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667130    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:37.672320 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667132    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667135    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667138    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667140    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667143    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667146    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667148    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667151    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667161    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667170    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667173    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667176    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667179    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667181    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667184    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667187    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667189    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667192    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667195    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667198    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:37.672760 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667200    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667203    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667206    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667209    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667212    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667215    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667217    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667220    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667223    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667225    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667228    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667231    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667233    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667236    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667238    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667241    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667244    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667246    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667249    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:37.673274 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667252    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667254    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667258    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667266    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667268    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667271    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667274    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667278    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667281    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667285    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667287    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667290    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667293    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667296    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667299    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667302    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667305    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667308    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667311    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:37.673718 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667313    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667316    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667319    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667321    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667324    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667326    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667329    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667331    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667334    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667338    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667342    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667344    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667347    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667350    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667352    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667355    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667357    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667366    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667369    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:37.674186 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667371    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667374    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667377    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667379    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667382    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667384    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667387    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667389    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667391    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667394    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667397    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667399    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667402    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667404    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667407    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667409    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667412    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667414    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667417    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667419    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:37.674637 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667421    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667424    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.667451    2586 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667640    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667645    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667649    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667652    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667655    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667657    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667660    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667663    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667671    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667674    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667677    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667679    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667682    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:37.675167 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667684    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667687    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667689    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667692    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667694    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667697    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667699    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667702    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667704    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667712    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667717    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667721    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667724    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667727    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667730    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667732    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667735    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667737    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667740    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:37.675548 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667742    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667745    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667748    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667750    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667753    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667755    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667758    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667761    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667763    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667772    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667775    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667777    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667780    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667782    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667785    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667787    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667790    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667793    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667795    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667798    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:37.675987 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667800    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667804    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667807    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667810    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667813    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667816    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667819    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667821    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667823    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667826    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667828    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667831    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667833    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667836    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667839    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667841    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667844    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667847    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667849    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667852    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:37.676475 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667854    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667857    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667866    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667869    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667871    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667874    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667877    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667879    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667882    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667884    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667887    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667889    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667892    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667895    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667897    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667900    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667902    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667905    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667907    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667910    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:37.676983 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667912    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667915    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667917    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667920    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667922    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667925    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667927    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667930    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667933    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667935    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667938    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667940    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667943    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.667946    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.667970    2586 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668039    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:38:37.677477 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668044    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668047    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668050    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668053    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668056    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668059    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668061    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668064    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668066    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668069    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668072    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668074    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668076    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668079    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668081    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668084    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668087    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668089    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668092    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668094    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:38:37.677868 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668097    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668099    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668102    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668104    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668107    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668109    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668112    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668114    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668117    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668119    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668122    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668124    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668132    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668135    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668138    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668140    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668143    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668145    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668148    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668150    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:38:37.678440 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668153    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668155    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668158    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668160    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668163    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668166    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668168    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668171    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668173    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668175    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668178    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668181    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668183    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668186    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668188    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668191    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668194    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668197    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668199    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:38:37.678896 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668203    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668208    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668211    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668214    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668217    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668219    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668227    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668230    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668233    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668235    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668238    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668241    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668243    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668246    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668248    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668252    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668254    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668257    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668259    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:38:37.679364 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668262    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668265    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668267    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668270    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668273    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668275    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668278    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668280    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668282    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668285    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668287    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668291    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668294    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668297    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668300    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668303    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668306    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668308    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668311    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668313    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:38:37.679804 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668321    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:38:37.680277 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668324    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:38:37.680277 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668327    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:38:37.680277 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668330    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:38:37.680277 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668333    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:38:37.680277 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668335    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:38:37.680277 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:37.668338    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:38:37.680277 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.668385    2586 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:38:37.680277 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.672632    2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 20:38:37.680277 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.674447    2586 server.go:1014] "Starting client certificate rotation"
Oct 30 20:38:37.680277 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.674547    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:38:37.680277 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.674584    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:38:37.680277 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.676539    2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:38:37.681069 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.681054    2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:38:37.691115 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.691098    2586 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:38:37.695746 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.695728    2586 log.go:25] "Validated CRI v1 image API"
Oct 30 20:38:37.696651 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.696631    2586 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:38:37.702218 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.702196    2586 fs.go:135] Filesystem UUIDs: map[37c8d8e7-da8f-4123-b2d7-dfb34057bff4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 870a77ff-aec5-482d-8ccd-2d21511610eb:/dev/nvme0n1p3]
Oct 30 20:38:37.702289 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.702216    2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 20:38:37.708390 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.708284    2586 manager.go:217] Machine: {Timestamp:2026-10-30 20:38:37.706918966 +0000 UTC m=+0.353114356 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099462 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24def61cc7fdb7c82afd29c2917e90 SystemUUID:ec24def6-1cc7-fdb7-c82a-fd29c2917e90 BootID:8383a4c7-17c0-40f2-b96c-c59012eb6993 Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d5:01:cf:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d5:01:cf:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:0d:94:a0:67:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:38:37.708390 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.708389    2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:38:37.708513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.708497    2586 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:38:37.708817 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.708803    2586 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:38:37.711573 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.711546    2586 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:38:37.711706 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.711574    2586 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-162.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:38:37.712851 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.712841    2586 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:38:37.712883 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.712852    2586 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:38:37.712883 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.712878    2586 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:38:37.712939 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.712891    2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:38:37.714320 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.714310    2586 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:38:37.718156 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.718145    2586 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:38:37.718274 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.718265    2586 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:38:37.718308 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.718295    2586 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:38:37.718308 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.718305    2586 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:38:37.718358 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.718315    2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:38:37.718358 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.718326    2586 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:38:37.718358 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.718335    2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:38:37.718713 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.718686    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:38:37.722653 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.722626    2586 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:38:37.727992 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.727974    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:38:37.728936 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.728921    2586 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:38:37.729003 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.728951    2586 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:38:37.730595 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.730578    2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hzbw6"
Oct 30 20:38:37.730880 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.730870    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:38:37.730919 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.730886    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:38:37.730919 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.730892    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:38:37.730919 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.730899    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:38:37.730919 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.730904    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:38:37.730919 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.730910    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:38:37.731899 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.731887    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:38:37.731899 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.731896    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:38:37.731899 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.731904    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:38:37.732049 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.731910    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:38:37.732049 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.731919    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:38:37.732049 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.731957    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:38:37.732581 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.732572    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:38:37.732615 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.732591    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:38:37.736980 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.736961    2586 server.go:1263] "Started kubelet"
Oct 30 20:38:37.737084 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.737047    2586 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:38:37.737188 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.737137    2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:38:37.737240 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.737218    2586 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:38:37.737850 ip-10-0-131-162 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:38:37.738546 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.738479    2586 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:38:37.739497 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.739477    2586 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:38:37.744213 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.744194    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hzbw6"
Oct 30 20:38:37.744555 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:37.744535    2586 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 20:38:37.746511 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.746492    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:38:37.747044 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.747003    2586 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:38:37.747276 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.747260    2586 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-162.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 20:38:37.747361 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:37.747268    2586 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:37.747431 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:37.747407    2586 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-162.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 20:38:37.747491 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:37.747409    2586 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 20:38:37.747843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.747819    2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:38:37.747843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.747838    2586 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:38:37.747989 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.747854    2586 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:38:37.747989 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.747925    2586 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:38:37.747989 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.747933    2586 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:38:37.748140 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.748125    2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:38:37.748173 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.748143    2586 factory.go:55] Registering systemd factory
Oct 30 20:38:37.748173 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.748153    2586 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:38:37.748451 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.748436    2586 factory.go:153] Registering CRI-O factory
Oct 30 20:38:37.748451 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.748449    2586 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:38:37.748565 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.748465    2586 factory.go:103] Registering Raw factory
Oct 30 20:38:37.748565 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.748478    2586 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:38:37.748565 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:37.746806    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-162.us-east-2.compute.internal.18e3692ccb7b55c2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-162.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-162.us-east-2.compute.internal,},FirstTimestamp:2026-10-30 20:38:37.73692461 +0000 UTC m=+0.383119996,LastTimestamp:2026-10-30 20:38:37.73692461 +0000 UTC m=+0.383119996,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-162.us-east-2.compute.internal,}"
Oct 30 20:38:37.749470 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.749456    2586 manager.go:319] Starting recovery of all containers
Oct 30 20:38:37.754404 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.754385    2586 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:37.757148 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.757113    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:38:37.761094 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:37.761068    2586 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-162.us-east-2.compute.internal\" not found" node="ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:37.762050 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.762032    2586 manager.go:324] Recovery completed
Oct 30 20:38:37.767381 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.767369    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:37.771011 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.770994    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:37.771086 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.771042    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:37.771086 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.771056    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:37.771570 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.771554    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:37.771667 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.771558    2586 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:38:37.771667 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.771588    2586 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:38:37.771667 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.771605    2586 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:38:37.773627 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.773614    2586 policy_none.go:50] "Start"
Oct 30 20:38:37.773679 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.773629    2586 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:38:37.773679 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.773639    2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:38:37.775590 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.775578    2586 policy_none.go:44] "Start"
Oct 30 20:38:37.779322 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.779305    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:37.779411 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.779334    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:37.779411 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.779349    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:37.825606 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.825582    2586 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:38:37.828018 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.828004    2586 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:38:37.828780 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:37.828765    2586 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:38:37.828840 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.828792    2586 server.go:87] "Starting device plugin registration server"
Oct 30 20:38:37.829047 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.829015    2586 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:38:37.829120 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.829046    2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:38:37.829168 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.829136    2586 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:38:37.829219 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.829208    2586 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:38:37.829255 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.829220    2586 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:38:37.829715 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:37.829690    2586 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:38:37.829780 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:37.829753    2586 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:37.908647 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.908571    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:38:37.908647 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.908595    2586 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:38:37.908647 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.908615    2586 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:38:37.910727 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:37.908656    2586 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 20:38:37.912702 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.912683    2586 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:37.929710 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.929696    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:37.930583 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.930566    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:37.930657 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.930597    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:37.930657 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.930609    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:37.930657 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.930633    2586 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:37.939402 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:37.939388    2586 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:37.939448 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:37.939409    2586 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-162.us-east-2.compute.internal\": node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:37.954650 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:37.954631    2586 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:38.009550 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.009519    2586 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"]
Oct 30 20:38:38.009679 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.009598    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:38.010608 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.010587    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:38.010708 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.010616    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:38.010708 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.010628    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:38.012766 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.012753    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:38.012925 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.012909    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.012959 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.012945    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:38.013582 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.013566    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:38.013662 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.013587    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:38.013662 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.013598    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:38.013662 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.013607    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:38.013662 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.013614    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:38.013662 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.013619    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:38.015604 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.015590    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.015658 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.015615    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:38:38.016336 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.016323    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:38:38.016432 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.016351    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:38:38.016432 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.016364    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:38:38.037309 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:38.037294    2586 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found" node="ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.039246 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:38.039228    2586 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found" node="ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.050134 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.050085    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c59dea9ec41d18b0bb9fc183e4c2006a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"c59dea9ec41d18b0bb9fc183e4c2006a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.050195 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.050143    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c59dea9ec41d18b0bb9fc183e4c2006a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"c59dea9ec41d18b0bb9fc183e4c2006a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.050195 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.050177    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/079b2b48b74377f18062751235dbf291-config\") pod \"kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"079b2b48b74377f18062751235dbf291\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.054740 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:38.054723    2586 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:38.150945 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.150910    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/079b2b48b74377f18062751235dbf291-config\") pod \"kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"079b2b48b74377f18062751235dbf291\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.150945 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.150940    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c59dea9ec41d18b0bb9fc183e4c2006a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"c59dea9ec41d18b0bb9fc183e4c2006a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.151159 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.150958    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c59dea9ec41d18b0bb9fc183e4c2006a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"c59dea9ec41d18b0bb9fc183e4c2006a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.151159 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.150996    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c59dea9ec41d18b0bb9fc183e4c2006a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"c59dea9ec41d18b0bb9fc183e4c2006a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.151159 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.151001    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/079b2b48b74377f18062751235dbf291-config\") pod \"kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"079b2b48b74377f18062751235dbf291\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.151159 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.151067    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c59dea9ec41d18b0bb9fc183e4c2006a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"c59dea9ec41d18b0bb9fc183e4c2006a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.155018 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:38.155000    2586 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:38.255829 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:38.255765    2586 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:38.339965 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.339929    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.342097 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.342077    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.356056 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:38.356038    2586 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:38.456557 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:38.456524    2586 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:38.557087 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:38.557060    2586 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:38.657923 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:38.657892    2586 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:38.673501 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.673475    2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 20:38:38.673628 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.673610    2586 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:38:38.673678 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.673649    2586 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:38:38.749813 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.749756    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:33:37 +0000 UTC" deadline="2028-06-20 09:37:50.609003756 +0000 UTC"
Oct 30 20:38:38.749813 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.749805    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14364h59m11.859201848s"
Oct 30 20:38:38.759101 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:38.759080    2586 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:38.859504 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:38.859313    2586 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:38:38.885263 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.885235    2586 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:38.947951 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.947925    2586 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.954800 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.954779    2586 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:38.961776 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.961759    2586 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:38.962715 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.962702    2586 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:38:38.971391 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:38.971373    2586 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:38:39.017542 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:39.017499    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59dea9ec41d18b0bb9fc183e4c2006a.slice/crio-4f9b88ab371bdb0b06b12e2e8fffc8113c24f1f0fa9edbd0a65ed6657ec025d1 WatchSource:0}: Error finding container 4f9b88ab371bdb0b06b12e2e8fffc8113c24f1f0fa9edbd0a65ed6657ec025d1: Status 404 returned error can't find the container with id 4f9b88ab371bdb0b06b12e2e8fffc8113c24f1f0fa9edbd0a65ed6657ec025d1
Oct 30 20:38:39.018108 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:39.018078    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079b2b48b74377f18062751235dbf291.slice/crio-1fdee27a5c298bf17ce3b450222bfcba30f451da581529672c8ba096b76f433f WatchSource:0}: Error finding container 1fdee27a5c298bf17ce3b450222bfcba30f451da581529672c8ba096b76f433f: Status 404 returned error can't find the container with id 1fdee27a5c298bf17ce3b450222bfcba30f451da581529672c8ba096b76f433f
Oct 30 20:38:39.024762 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.024744    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:38:39.603794 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.603768    2586 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:39.720012 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.719977    2586 apiserver.go:52] "Watching apiserver"
Oct 30 20:38:39.734752 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.734050    2586 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:38:39.734752 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.734411    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-dnqc4","openshift-multus/network-metrics-daemon-d4pmp","openshift-cluster-node-tuning-operator/tuned-zbxjw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal","openshift-multus/multus-4cmph","openshift-ovn-kubernetes/ovnkube-node-kjpxk","kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t","openshift-image-registry/node-ca-45j6n","openshift-network-diagnostics/network-check-target-g5cnl","kube-system/global-pull-secret-syncer-8p5hf","openshift-network-operator/iptables-alerter-5qtnx","kube-system/konnectivity-agent-lvlkq","openshift-dns/node-resolver-zv2n9"]
Oct 30 20:38:39.736840 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.736819    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:38:39.740279 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.740256    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:39.740376 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:39.740341    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:38:39.741981 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.741954    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.742709 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.742691    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:38:39.742841 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.742828    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-r2q8w\""
Oct 30 20:38:39.742921 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.742905    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:38:39.744720 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.743776    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.746763 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.746313    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.747041 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.746971    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 20:38:39.748275 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.748259    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.750123 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.750094    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:39.750932 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.750913    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:38:39.753401 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.753382    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.756382 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.756362    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:38:39.759345 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759321    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-ovnkube-script-lib\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.759441 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759357    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c6ef821a-391c-4775-9cf4-f54b1a4d247d-agent-certs\") pod \"konnectivity-agent-lvlkq\" (UID: \"c6ef821a-391c-4775-9cf4-f54b1a4d247d\") " pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:38:39.759441 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759385    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysconfig\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.759441 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759412    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-host\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.759601 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759442    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.759601 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759480    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-cni-bin\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.759601 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759539    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c6ef821a-391c-4775-9cf4-f54b1a4d247d-konnectivity-ca\") pod \"konnectivity-agent-lvlkq\" (UID: \"c6ef821a-391c-4775-9cf4-f54b1a4d247d\") " pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:38:39.759601 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759576    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysctl-conf\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759618    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-cnibin\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759622    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759634    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-ovnkube-config\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759659    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98cqt\" (UniqueName: \"kubernetes.io/projected/fbd28ece-83af-4175-a32f-774fe77aae9f-kube-api-access-98cqt\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759677    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759691    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-var-lib-kubelet\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:39.759686    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759705    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-var-lib-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759736    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759751    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-netns\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759766    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-daemon-config\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759793    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-multus-certs\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.759799 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759808    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95s77\" (UniqueName: \"kubernetes.io/projected/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-kube-api-access-95s77\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759823    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-modprobe-d\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759840    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-systemd\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759855    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-kubelet\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759912    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-hostroot\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.759959    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-etc-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760110    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01fae3a3-8169-40f8-b7b8-d313c96b6add-tmp\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760139    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cnibin\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760175    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-log-socket\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760220    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760252    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysctl-d\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760301    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760324    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-cni-netd\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760346    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-env-overrides\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.760383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760366    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-etc-kubernetes\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760585    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlhs8\" (UniqueName: \"kubernetes.io/projected/f01d076a-94ad-4eb5-8886-0771d5a50440-kube-api-access-wlhs8\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760619    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-kubelet\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760650    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f01d076a-94ad-4eb5-8886-0771d5a50440-cni-binary-copy\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760676    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-cni-multus\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760715    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760735    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-lib-modules\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760765    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-system-cni-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760787    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-k8s-cni-cncf-io\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760807    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-run-netns\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760828    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-ovn\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760851    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-run\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760870    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-socket-dir-parent\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760884    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-cni-bin\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760904    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-slash\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760927    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ltvz\" (UniqueName: \"kubernetes.io/projected/01fae3a3-8169-40f8-b7b8-d313c96b6add-kube-api-access-5ltvz\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.761059 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.760995    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-system-cni-dir\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.761810 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761155    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5wl6\" (UniqueName: \"kubernetes.io/projected/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-kube-api-access-b5wl6\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.761810 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761235    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-kubernetes\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.761810 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761264    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-tuned\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.761810 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761289    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.761810 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761323    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-systemd-units\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.761810 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761347    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-systemd\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.761810 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761389    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-node-log\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.761810 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761415    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.761810 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761464    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbd28ece-83af-4175-a32f-774fe77aae9f-ovn-node-metrics-cert\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.761810 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761581    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-sys\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.761810 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761633    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-cni-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.761810 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761658    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-conf-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.762387 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.761956    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:39.762387 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:39.762157    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:38:39.763092 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.763074    2586 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:38:39.765684 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.765664    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:38:39.773349 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.773323    2586 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:38:39.787578 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.787557    2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8lbm8"
Oct 30 20:38:39.799917 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.799896    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8lbm8"
Oct 30 20:38:39.842785 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.842758    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:38:39.842927 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.842844    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:38:39.842927 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.842910    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:38:39.843311 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.843294    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:39.843375 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.843342    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:38:39.843425 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.843375    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:38:39.843475 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.843452    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9r6zk\""
Oct 30 20:38:39.843560 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.843534    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:38:39.843707 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.843693    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:38:39.843774 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.843763    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:38:39.843947 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.843927    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:38:39.844213 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.844187    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:38:39.844327 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.844230    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:38:39.844327 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.844248    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:38:39.845344 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.844616    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:38:39.845344 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.844677    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:38:39.845344 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.844708    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:38:39.845344 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.844978    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jrnvk\""
Oct 30 20:38:39.845344 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.845185    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:38:39.845344 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.845233    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:38:39.845344 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.845269    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:38:39.845344 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.845300    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:38:39.845344 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.845303    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:38:39.846287 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.846268    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mnk4k\""
Oct 30 20:38:39.846404 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.846317    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cctqn\""
Oct 30 20:38:39.846487 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.846429    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:38:39.846736 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.846717    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z6v2d\""
Oct 30 20:38:39.846802 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.846776    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-wzc24\""
Oct 30 20:38:39.846843 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.846835    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9s58x\""
Oct 30 20:38:39.846891 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.846876    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nxdl7\""
Oct 30 20:38:39.846950 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.846918    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:38:39.846950 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.846945    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:38:39.849197 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.849181    2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:38:39.862706 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.862648    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-slash\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.862706 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.862686    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ltvz\" (UniqueName: \"kubernetes.io/projected/01fae3a3-8169-40f8-b7b8-d313c96b6add-kube-api-access-5ltvz\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.862850 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.862712    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-system-cni-dir\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.862850 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.862738    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5wl6\" (UniqueName: \"kubernetes.io/projected/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-kube-api-access-b5wl6\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.862850 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.862790    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-slash\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.862850 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.862795    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-system-cni-dir\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.862850 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.862822    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h64qc\" (UniqueName: \"kubernetes.io/projected/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-kube-api-access-h64qc\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:38:39.863146 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.862853    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-device-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.863146 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.862872    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-sys-fs\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.863146 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.862900    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-kubernetes\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.863146 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.862917    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-tuned\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.863146 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.862967    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.863146 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863000    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.863146 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863108    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-systemd-units\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.863146 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863143    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-kubernetes\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863164    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-systemd\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863188    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-systemd-units\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863227    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-node-log\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863255    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863283    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbd28ece-83af-4175-a32f-774fe77aae9f-ovn-node-metrics-cert\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863288    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-systemd\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863334    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-sys\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863340    2586 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863360    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-cni-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863366    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-node-log\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863417    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-conf-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863448    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn92l\" (UniqueName: \"kubernetes.io/projected/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-kube-api-access-fn92l\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863476    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-ovnkube-script-lib\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863476    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.863513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863505    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863547    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-cni-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863582    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c6ef821a-391c-4775-9cf4-f54b1a4d247d-agent-certs\") pod \"konnectivity-agent-lvlkq\" (UID: \"c6ef821a-391c-4775-9cf4-f54b1a4d247d\") " pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863600    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysconfig\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863601    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-conf-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863645    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysconfig\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863652    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-host\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863672    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-sys\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863687    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863803    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-host\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863830    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-socket-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863875    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkgw8\" (UniqueName: \"kubernetes.io/projected/c5071a82-ea2d-426c-83da-9eae94007232-kube-api-access-jkgw8\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863914    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-cni-bin\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863951    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c6ef821a-391c-4775-9cf4-f54b1a4d247d-konnectivity-ca\") pod \"konnectivity-agent-lvlkq\" (UID: \"c6ef821a-391c-4775-9cf4-f54b1a4d247d\") " pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.863979    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysctl-conf\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864001    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-cnibin\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864040    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-ovnkube-config\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.864243 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864065    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98cqt\" (UniqueName: \"kubernetes.io/projected/fbd28ece-83af-4175-a32f-774fe77aae9f-kube-api-access-98cqt\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864155    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864182    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-var-lib-kubelet\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864240    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-var-lib-kubelet\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864282    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-cnibin\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864281    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-cni-bin\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864336    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-host\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864477    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-serviceca\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864539    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-host-slash\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864566    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-var-lib-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864583    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-ovnkube-script-lib\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864599    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864640    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-netns\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864667    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-daemon-config\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864693    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-multus-certs\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864718    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-registration-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864744    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95s77\" (UniqueName: \"kubernetes.io/projected/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-kube-api-access-95s77\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:39.865064 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864770    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-modprobe-d\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864788    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864796    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-systemd\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864815    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c6ef821a-391c-4775-9cf4-f54b1a4d247d-konnectivity-ca\") pod \"konnectivity-agent-lvlkq\" (UID: \"c6ef821a-391c-4775-9cf4-f54b1a4d247d\") " pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864822    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-kubelet\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864810    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-ovnkube-config\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864854    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-hostroot\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:39.864857    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864891    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-hostroot\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864891    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-netns\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864891    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-kubelet-config\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:39.864924    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs podName:b3a3268c-635f-4eb2-a85d-f9c42a5d4db7 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:40.364907296 +0000 UTC m=+3.011102669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs") pod "network-metrics-daemon-d4pmp" (UID: "b3a3268c-635f-4eb2-a85d-f9c42a5d4db7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864956    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-etc-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864960    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-multus-certs\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864978    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01fae3a3-8169-40f8-b7b8-d313c96b6add-tmp\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.864998    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cnibin\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865006    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-systemd\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.865798 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865040    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-976qn\" (UniqueName: \"kubernetes.io/projected/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-kube-api-access-976qn\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865062    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-dbus\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865075    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-var-lib-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865100    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-log-socket\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865117    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-kubelet\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865287    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysctl-conf\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865336    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cnibin\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865340    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-modprobe-d\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865371    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-etc-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865401    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865410    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-log-socket\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865445    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysctl-d\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865459    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865493    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865517    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-cni-netd\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865550    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-env-overrides\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865574    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-etc-kubernetes\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.866484 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865599    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlhs8\" (UniqueName: \"kubernetes.io/projected/f01d076a-94ad-4eb5-8886-0771d5a50440-kube-api-access-wlhs8\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865617    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysctl-d\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865644    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-tmp-dir\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865659    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-cni-netd\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865673    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865699    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-kubelet\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865724    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f01d076a-94ad-4eb5-8886-0771d5a50440-cni-binary-copy\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865765    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-cni-multus\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865794    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8474p\" (UniqueName: \"kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p\") pod \"network-check-target-g5cnl\" (UID: \"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5\") " pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865820    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-iptables-alerter-script\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865843    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865865    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-lib-modules\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865887    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-system-cni-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865913    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-k8s-cni-cncf-io\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865939    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.865984    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-run-netns\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866007    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-ovn\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.868161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866050    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-run\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866073    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-socket-dir-parent\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866092    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-daemon-config\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866114    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-cni-bin\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866144    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-hosts-file\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866228    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866237    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866306    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-lib-modules\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866349    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-system-cni-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866383    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-k8s-cni-cncf-io\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866425    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-run-netns\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866456    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-ovn\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866491    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-etc-kubernetes\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866501    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-run\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866535    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-cni-multus\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866565    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f01d076a-94ad-4eb5-8886-0771d5a50440-cni-binary-copy\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866586    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-socket-dir-parent\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866630    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-cni-bin\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.868973 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866650    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-kubelet\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.869802 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.866700    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.869802 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.867063    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-env-overrides\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.869802 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.867611    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-tuned\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.869802 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.867782    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c6ef821a-391c-4775-9cf4-f54b1a4d247d-agent-certs\") pod \"konnectivity-agent-lvlkq\" (UID: \"c6ef821a-391c-4775-9cf4-f54b1a4d247d\") " pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:38:39.869802 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.868482    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01fae3a3-8169-40f8-b7b8-d313c96b6add-tmp\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.870811 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.870785    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbd28ece-83af-4175-a32f-774fe77aae9f-ovn-node-metrics-cert\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.881432 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.881404    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ltvz\" (UniqueName: \"kubernetes.io/projected/01fae3a3-8169-40f8-b7b8-d313c96b6add-kube-api-access-5ltvz\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:39.882708 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.882665    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5wl6\" (UniqueName: \"kubernetes.io/projected/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-kube-api-access-b5wl6\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:39.883966 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.883941    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98cqt\" (UniqueName: \"kubernetes.io/projected/fbd28ece-83af-4175-a32f-774fe77aae9f-kube-api-access-98cqt\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:39.889500 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.889461    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95s77\" (UniqueName: \"kubernetes.io/projected/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-kube-api-access-95s77\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:39.891598 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.891572    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlhs8\" (UniqueName: \"kubernetes.io/projected/f01d076a-94ad-4eb5-8886-0771d5a50440-kube-api-access-wlhs8\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:38:39.915244 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.915191    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal" event={"ID":"079b2b48b74377f18062751235dbf291","Type":"ContainerStarted","Data":"1fdee27a5c298bf17ce3b450222bfcba30f451da581529672c8ba096b76f433f"}
Oct 30 20:38:39.916730 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.916705    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal" event={"ID":"c59dea9ec41d18b0bb9fc183e4c2006a","Type":"ContainerStarted","Data":"4f9b88ab371bdb0b06b12e2e8fffc8113c24f1f0fa9edbd0a65ed6657ec025d1"}
Oct 30 20:38:39.967220 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967184    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.967374 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967234    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-hosts-file\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:38:39.967374 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967286    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h64qc\" (UniqueName: \"kubernetes.io/projected/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-kube-api-access-h64qc\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:38:39.967374 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967325    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-device-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.967374 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967349    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-sys-fs\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.967374 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967373    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.967628 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967403    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn92l\" (UniqueName: \"kubernetes.io/projected/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-kube-api-access-fn92l\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:38:39.967628 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967433    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-host\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:38:39.967628 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967456    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-socket-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.967628 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967464    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.967628 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967481    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkgw8\" (UniqueName: \"kubernetes.io/projected/c5071a82-ea2d-426c-83da-9eae94007232-kube-api-access-jkgw8\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.967628 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967525    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-serviceca\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:38:39.967628 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967592    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-hosts-file\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:38:39.967955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967639    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-host-slash\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:38:39.967955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967661    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-registration-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.967955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967680    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-kubelet-config\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:39.967955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967697    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-976qn\" (UniqueName: \"kubernetes.io/projected/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-kube-api-access-976qn\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:38:39.967955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967712    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-dbus\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:39.967955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967735    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-tmp-dir\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:38:39.967955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967749    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:39.967955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967766    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8474p\" (UniqueName: \"kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p\") pod \"network-check-target-g5cnl\" (UID: \"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5\") " pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:39.967955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967781    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-iptables-alerter-script\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:38:39.967955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967808    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-device-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.967955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967871    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-sys-fs\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.967955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.967930    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.968534 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.968163    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-host\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:38:39.968534 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.968284    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-socket-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.968534 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.968461    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-iptables-alerter-script\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:38:39.968680 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.968542    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-host-slash\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:38:39.968680 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.968565    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-registration-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:39.968680 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.968577    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-dbus\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:39.968680 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.968605    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-kubelet-config\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:39.968966 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:39.968939    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:39.968966 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.968959    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-serviceca\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:38:39.969127 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.968983    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-tmp-dir\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:38:39.969127 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:39.968986    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret podName:c28bc8e0-d670-4b43-bab5-d51bdbe1a350 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:40.468974655 +0000 UTC m=+3.115170064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret") pod "global-pull-secret-syncer-8p5hf" (UID: "c28bc8e0-d670-4b43-bab5-d51bdbe1a350") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:39.979614 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:39.979593    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:39.979614 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:39.979619    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:39.979799 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:39.979631    2586 projected.go:196] Error preparing data for projected volume kube-api-access-8474p for pod openshift-network-diagnostics/network-check-target-g5cnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:39.979799 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:39.979699    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p podName:1b3d2ec1-b5f3-499e-a5e2-b524d57837b5 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:40.479674099 +0000 UTC m=+3.125869494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8474p" (UniqueName: "kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p") pod "network-check-target-g5cnl" (UID: "1b3d2ec1-b5f3-499e-a5e2-b524d57837b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:39.982505 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.982477    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h64qc\" (UniqueName: \"kubernetes.io/projected/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-kube-api-access-h64qc\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:38:39.983259 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.983238    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-976qn\" (UniqueName: \"kubernetes.io/projected/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-kube-api-access-976qn\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:38:39.983459 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.983438    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn92l\" (UniqueName: \"kubernetes.io/projected/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-kube-api-access-fn92l\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:38:39.987189 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:39.987168    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkgw8\" (UniqueName: \"kubernetes.io/projected/c5071a82-ea2d-426c-83da-9eae94007232-kube-api-access-jkgw8\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:40.053043 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.052994    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:38:40.061947 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.061908    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:38:40.062293 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:40.062265    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ef821a_391c_4775_9cf4_f54b1a4d247d.slice/crio-302193ecf56ef78205adbdf4ce9f0eb6324dd7462565394da72a2404ce9a1ea9 WatchSource:0}: Error finding container 302193ecf56ef78205adbdf4ce9f0eb6324dd7462565394da72a2404ce9a1ea9: Status 404 returned error can't find the container with id 302193ecf56ef78205adbdf4ce9f0eb6324dd7462565394da72a2404ce9a1ea9
Oct 30 20:38:40.070626 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:40.070599    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01fae3a3_8169_40f8_b7b8_d313c96b6add.slice/crio-8f4e3c4afedfc8bd44ff42d8555ae9bcb6a8f3cdf0da9134717ffe241c2af1b2 WatchSource:0}: Error finding container 8f4e3c4afedfc8bd44ff42d8555ae9bcb6a8f3cdf0da9134717ffe241c2af1b2: Status 404 returned error can't find the container with id 8f4e3c4afedfc8bd44ff42d8555ae9bcb6a8f3cdf0da9134717ffe241c2af1b2
Oct 30 20:38:40.084379 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.084354    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4cmph"
Oct 30 20:38:40.086513 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.086491    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:38:40.095486 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:40.095463    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf01d076a_94ad_4eb5_8886_0771d5a50440.slice/crio-2f80595f08b8ae4d2913fe97ee2f206a1876f8f5453360ee98078063c4f66014 WatchSource:0}: Error finding container 2f80595f08b8ae4d2913fe97ee2f206a1876f8f5453360ee98078063c4f66014: Status 404 returned error can't find the container with id 2f80595f08b8ae4d2913fe97ee2f206a1876f8f5453360ee98078063c4f66014
Oct 30 20:38:40.099261 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.099237    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:38:40.106042 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.105996    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:38:40.110525 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:40.110486    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b22c6f_4f13_4e54_9304_cfa57f52fbe1.slice/crio-7fe042e648a2d438bfccf23709449378b3b9acb75f58e71ea91eeaa47c55313b WatchSource:0}: Error finding container 7fe042e648a2d438bfccf23709449378b3b9acb75f58e71ea91eeaa47c55313b: Status 404 returned error can't find the container with id 7fe042e648a2d438bfccf23709449378b3b9acb75f58e71ea91eeaa47c55313b
Oct 30 20:38:40.113096 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.112738    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:38:40.115185 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.115165    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:38:40.116084 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:40.116060    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd28ece_83af_4175_a32f_774fe77aae9f.slice/crio-8d8228f788316bce4e6637a28679a7abacfc962f7671cfacabeb6bbb7740ef5b WatchSource:0}: Error finding container 8d8228f788316bce4e6637a28679a7abacfc962f7671cfacabeb6bbb7740ef5b: Status 404 returned error can't find the container with id 8d8228f788316bce4e6637a28679a7abacfc962f7671cfacabeb6bbb7740ef5b
Oct 30 20:38:40.116978 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.116957    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:38:40.127681 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:40.127654    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840bcd20_c702_4818_8e4e_0caa0ae2ffe3.slice/crio-9e994b987cf79e6aef1f63fda9266ad24179b5f16f626a1f2b2819e48e9668ff WatchSource:0}: Error finding container 9e994b987cf79e6aef1f63fda9266ad24179b5f16f626a1f2b2819e48e9668ff: Status 404 returned error can't find the container with id 9e994b987cf79e6aef1f63fda9266ad24179b5f16f626a1f2b2819e48e9668ff
Oct 30 20:38:40.129904 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:38:40.129863    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c4b5665_fa3f_4a84_ac04_ee8ca7eb18c1.slice/crio-8c1d56b3727d63b653a5bdf6d6eff2d188146adaf217cbbc16d82acd6e4c4ff7 WatchSource:0}: Error finding container 8c1d56b3727d63b653a5bdf6d6eff2d188146adaf217cbbc16d82acd6e4c4ff7: Status 404 returned error can't find the container with id 8c1d56b3727d63b653a5bdf6d6eff2d188146adaf217cbbc16d82acd6e4c4ff7
Oct 30 20:38:40.370957 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.370881    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:40.371101 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:40.371011    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:40.371101 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:40.371091    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs podName:b3a3268c-635f-4eb2-a85d-f9c42a5d4db7 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:41.371076606 +0000 UTC m=+4.017271993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs") pod "network-metrics-daemon-d4pmp" (UID: "b3a3268c-635f-4eb2-a85d-f9c42a5d4db7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:40.472143 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.472114    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:40.472252 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:40.472237    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:40.472301 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:40.472292    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret podName:c28bc8e0-d670-4b43-bab5-d51bdbe1a350 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:41.472279885 +0000 UTC m=+4.118475272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret") pod "global-pull-secret-syncer-8p5hf" (UID: "c28bc8e0-d670-4b43-bab5-d51bdbe1a350") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:40.572724 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.572687    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8474p\" (UniqueName: \"kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p\") pod \"network-check-target-g5cnl\" (UID: \"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5\") " pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:40.572914 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:40.572875    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:40.572914 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:40.572899    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:40.572914 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:40.572912    2586 projected.go:196] Error preparing data for projected volume kube-api-access-8474p for pod openshift-network-diagnostics/network-check-target-g5cnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:40.573084 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:40.572973    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p podName:1b3d2ec1-b5f3-499e-a5e2-b524d57837b5 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:41.572954684 +0000 UTC m=+4.219150072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8474p" (UniqueName: "kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p") pod "network-check-target-g5cnl" (UID: "1b3d2ec1-b5f3-499e-a5e2-b524d57837b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:40.803132 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.803010    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:33:39 +0000 UTC" deadline="2028-04-16 08:23:44.74429284 +0000 UTC"
Oct 30 20:38:40.803132 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.803087    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12803h45m3.941210278s"
Oct 30 20:38:40.913592 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.913566    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:40.913771 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:40.913738    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:38:40.930713 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.930678    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t" event={"ID":"c5071a82-ea2d-426c-83da-9eae94007232","Type":"ContainerStarted","Data":"db92f8226a7e88de443efa78a8be1e82e50101613499bfb5699744a195ecfae7"}
Oct 30 20:38:40.938851 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.938748    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zv2n9" event={"ID":"33b22c6f-4f13-4e54-9304-cfa57f52fbe1","Type":"ContainerStarted","Data":"7fe042e648a2d438bfccf23709449378b3b9acb75f58e71ea91eeaa47c55313b"}
Oct 30 20:38:40.950795 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.950764    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lvlkq" event={"ID":"c6ef821a-391c-4775-9cf4-f54b1a4d247d","Type":"ContainerStarted","Data":"302193ecf56ef78205adbdf4ce9f0eb6324dd7462565394da72a2404ce9a1ea9"}
Oct 30 20:38:40.956084 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.956054    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk" event={"ID":"fbd28ece-83af-4175-a32f-774fe77aae9f","Type":"ContainerStarted","Data":"8d8228f788316bce4e6637a28679a7abacfc962f7671cfacabeb6bbb7740ef5b"}
Oct 30 20:38:40.964013 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.963985    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnqc4" event={"ID":"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c","Type":"ContainerStarted","Data":"96e953c5ee9433035f75b131726e33539afad27b08b4802560262dde3af9ea68"}
Oct 30 20:38:40.967695 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.967633    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4cmph" event={"ID":"f01d076a-94ad-4eb5-8886-0771d5a50440","Type":"ContainerStarted","Data":"2f80595f08b8ae4d2913fe97ee2f206a1876f8f5453360ee98078063c4f66014"}
Oct 30 20:38:40.971100 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.971075    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zbxjw" event={"ID":"01fae3a3-8169-40f8-b7b8-d313c96b6add","Type":"ContainerStarted","Data":"8f4e3c4afedfc8bd44ff42d8555ae9bcb6a8f3cdf0da9134717ffe241c2af1b2"}
Oct 30 20:38:40.989226 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.989195    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5qtnx" event={"ID":"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1","Type":"ContainerStarted","Data":"8c1d56b3727d63b653a5bdf6d6eff2d188146adaf217cbbc16d82acd6e4c4ff7"}
Oct 30 20:38:40.993386 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:40.993295    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-45j6n" event={"ID":"840bcd20-c702-4818-8e4e-0caa0ae2ffe3","Type":"ContainerStarted","Data":"9e994b987cf79e6aef1f63fda9266ad24179b5f16f626a1f2b2819e48e9668ff"}
Oct 30 20:38:41.379590 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:41.379501    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:41.379753 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:41.379741    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:41.379836 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:41.379824    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs podName:b3a3268c-635f-4eb2-a85d-f9c42a5d4db7 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:43.379785245 +0000 UTC m=+6.025980632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs") pod "network-metrics-daemon-d4pmp" (UID: "b3a3268c-635f-4eb2-a85d-f9c42a5d4db7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:41.480604 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:41.480017    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:41.480604 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:41.480181    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:41.480604 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:41.480249    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret podName:c28bc8e0-d670-4b43-bab5-d51bdbe1a350 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:43.480227091 +0000 UTC m=+6.126422482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret") pod "global-pull-secret-syncer-8p5hf" (UID: "c28bc8e0-d670-4b43-bab5-d51bdbe1a350") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:41.580909 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:41.580871    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8474p\" (UniqueName: \"kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p\") pod \"network-check-target-g5cnl\" (UID: \"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5\") " pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:41.581086 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:41.581065    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:41.581152 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:41.581086    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:41.581152 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:41.581099    2586 projected.go:196] Error preparing data for projected volume kube-api-access-8474p for pod openshift-network-diagnostics/network-check-target-g5cnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:41.581250 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:41.581153    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p podName:1b3d2ec1-b5f3-499e-a5e2-b524d57837b5 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:43.581136393 +0000 UTC m=+6.227331772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8474p" (UniqueName: "kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p") pod "network-check-target-g5cnl" (UID: "1b3d2ec1-b5f3-499e-a5e2-b524d57837b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:41.803613 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:41.803478    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:33:39 +0000 UTC" deadline="2028-04-22 16:36:11.564927586 +0000 UTC"
Oct 30 20:38:41.803613 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:41.803536    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12955h57m29.761395673s"
Oct 30 20:38:41.910623 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:41.910146    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:41.910623 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:41.910269    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:38:41.911178 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:41.910971    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:41.911178 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:41.911094    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:38:42.010913 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:42.010875    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal" event={"ID":"079b2b48b74377f18062751235dbf291","Type":"ContainerStarted","Data":"a513a041a1457172d296213cba4ba482b4ea671fb414abc34049dbacc8800d32"}
Oct 30 20:38:42.026663 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:42.026627    2586 generic.go:356] "Generic (PLEG): container finished" podID="c59dea9ec41d18b0bb9fc183e4c2006a" containerID="b31a137b88faf691823973749cc814340c6b31e7be5594dfb20f99c344e1c0fc" exitCode=0
Oct 30 20:38:42.026830 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:42.026682    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal" event={"ID":"c59dea9ec41d18b0bb9fc183e4c2006a","Type":"ContainerDied","Data":"b31a137b88faf691823973749cc814340c6b31e7be5594dfb20f99c344e1c0fc"}
Oct 30 20:38:42.051620 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:42.050837    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal" podStartSLOduration=3.050817939 podStartE2EDuration="3.050817939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:42.028897659 +0000 UTC m=+4.675093058" watchObservedRunningTime="2026-10-30 20:38:42.050817939 +0000 UTC m=+4.697013335"
Oct 30 20:38:42.909995 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:42.909753    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:42.910444 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:42.910160    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:38:43.047118 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:43.047085    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal" event={"ID":"c59dea9ec41d18b0bb9fc183e4c2006a","Type":"ContainerStarted","Data":"3ddfcdcde43caf31e082c6453a4102f4547d956f15899f86ca37f8c98f21c251"}
Oct 30 20:38:43.396229 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:43.396189    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:43.396432 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:43.396406    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:43.396503 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:43.396482    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs podName:b3a3268c-635f-4eb2-a85d-f9c42a5d4db7 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:47.396464381 +0000 UTC m=+10.042659777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs") pod "network-metrics-daemon-d4pmp" (UID: "b3a3268c-635f-4eb2-a85d-f9c42a5d4db7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:43.497452 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:43.496840    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:43.497452 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:43.496999    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:43.497452 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:43.497074    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret podName:c28bc8e0-d670-4b43-bab5-d51bdbe1a350 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:47.497056634 +0000 UTC m=+10.143252010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret") pod "global-pull-secret-syncer-8p5hf" (UID: "c28bc8e0-d670-4b43-bab5-d51bdbe1a350") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:43.598632 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:43.597972    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8474p\" (UniqueName: \"kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p\") pod \"network-check-target-g5cnl\" (UID: \"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5\") " pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:43.598632 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:43.598177    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:43.598632 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:43.598198    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:43.598632 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:43.598214    2586 projected.go:196] Error preparing data for projected volume kube-api-access-8474p for pod openshift-network-diagnostics/network-check-target-g5cnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:43.598632 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:43.598281    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p podName:1b3d2ec1-b5f3-499e-a5e2-b524d57837b5 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:47.598261168 +0000 UTC m=+10.244456547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8474p" (UniqueName: "kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p") pod "network-check-target-g5cnl" (UID: "1b3d2ec1-b5f3-499e-a5e2-b524d57837b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:43.917953 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:43.917337    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:43.917953 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:43.917505    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:38:43.921721 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:43.918771    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:43.921721 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:43.918901    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:38:44.053763 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:44.053127    2586 generic.go:356] "Generic (PLEG): container finished" podID="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" containerID="86b459d2517c94b35d20ca2128de0d0135e6e1dad8cda83dea75f6bb78d0166b" exitCode=0
Oct 30 20:38:44.054264 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:44.054238    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnqc4" event={"ID":"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c","Type":"ContainerDied","Data":"86b459d2517c94b35d20ca2128de0d0135e6e1dad8cda83dea75f6bb78d0166b"}
Oct 30 20:38:44.082694 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:44.082326    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal" podStartSLOduration=5.082311199 podStartE2EDuration="5.082311199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:43.069879795 +0000 UTC m=+5.716075207" watchObservedRunningTime="2026-10-30 20:38:44.082311199 +0000 UTC m=+6.728506595"
Oct 30 20:38:44.909688 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:44.909292    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:44.909688 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:44.909403    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:38:45.058606 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:45.058564    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-45j6n" event={"ID":"840bcd20-c702-4818-8e4e-0caa0ae2ffe3","Type":"ContainerStarted","Data":"9e742b0f6bf61d46e73e0f0c4d13a5ad17ff17e83d90dc7390664b34023e9c4b"}
Oct 30 20:38:45.063817 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:45.063791    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lvlkq" event={"ID":"c6ef821a-391c-4775-9cf4-f54b1a4d247d","Type":"ContainerStarted","Data":"77e5afde1404872a79c1e0c057f56bc8fcaa15bd8c101323638d0ad364dd7a6a"}
Oct 30 20:38:45.095131 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:45.095039    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-45j6n" podStartSLOduration=2.396111285 podStartE2EDuration="7.095007843s" totalImagesPullingTime="4.698896558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:45.07836921 +0000 UTC m=+7.724564606" watchObservedRunningTime="2026-10-30 20:38:45.095007843 +0000 UTC m=+7.741203240"
Oct 30 20:38:45.911630 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:45.911545    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:45.911774 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:45.911676    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:38:45.911774 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:45.911739    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:45.911853 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:45.911812    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:38:46.071161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:46.071082    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t" event={"ID":"c5071a82-ea2d-426c-83da-9eae94007232","Type":"ContainerStarted","Data":"381aeed3c909461efc26efcfaff1ca74fc9aeffdace04098fe5bc008028722f9"}
Oct 30 20:38:46.909635 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:46.908947    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:46.909635 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:46.909112    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:38:47.431157 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:47.431127    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:47.431590 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:47.431284    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:47.431590 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:47.431347    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs podName:b3a3268c-635f-4eb2-a85d-f9c42a5d4db7 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:55.431329515 +0000 UTC m=+18.077524905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs") pod "network-metrics-daemon-d4pmp" (UID: "b3a3268c-635f-4eb2-a85d-f9c42a5d4db7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:47.468158 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:47.468097    2586 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:38:47.532559 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:47.531951    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:47.532559 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:47.532134    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:47.532559 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:47.532200    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret podName:c28bc8e0-d670-4b43-bab5-d51bdbe1a350 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:55.532182418 +0000 UTC m=+18.178377791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret") pod "global-pull-secret-syncer-8p5hf" (UID: "c28bc8e0-d670-4b43-bab5-d51bdbe1a350") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:47.633330 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:47.632645    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8474p\" (UniqueName: \"kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p\") pod \"network-check-target-g5cnl\" (UID: \"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5\") " pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:47.633330 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:47.632829    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:47.633330 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:47.632851    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:47.633330 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:47.632865    2586 projected.go:196] Error preparing data for projected volume kube-api-access-8474p for pod openshift-network-diagnostics/network-check-target-g5cnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:47.633330 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:47.632927    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p podName:1b3d2ec1-b5f3-499e-a5e2-b524d57837b5 nodeName:}" failed. No retries permitted until 2026-10-30 20:38:55.632908103 +0000 UTC m=+18.279103499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8474p" (UniqueName: "kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p") pod "network-check-target-g5cnl" (UID: "1b3d2ec1-b5f3-499e-a5e2-b524d57837b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:47.835037 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:47.834927    2586 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:38:47.468121743Z","UUID":"47da4df1-d6ff-4ed4-b5b7-6bc929c78948","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:38:47.840897 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:47.840863    2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:38:47.841009 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:47.840913    2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:38:47.912063 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:47.912005    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:47.912182 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:47.912126    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:38:47.912456 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:47.912435    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:47.912567 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:47.912521    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:38:48.076572 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:48.076542    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t" event={"ID":"c5071a82-ea2d-426c-83da-9eae94007232","Type":"ContainerStarted","Data":"e05436dd002dc569ba04fad9abfe8046d9ac8dad914f8dd22d69dac77cf191cb"}
Oct 30 20:38:48.078657 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:48.078630    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4cmph" event={"ID":"f01d076a-94ad-4eb5-8886-0771d5a50440","Type":"ContainerStarted","Data":"1155f00dc93dbd93d93b214f15cc3eacf0606fa933d8585436893adc3c8f05a8"}
Oct 30 20:38:48.100831 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:48.100787    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lvlkq" podStartSLOduration=6.288241537 podStartE2EDuration="10.100773356s" totalImagesPullingTime="3.812531819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:45.09614556 +0000 UTC m=+7.742341160" watchObservedRunningTime="2026-10-30 20:38:48.100773356 +0000 UTC m=+10.746968747"
Oct 30 20:38:48.289482 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:48.289410    2586 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:38:48.290435 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:48.290413    2586 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:38:48.307675 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:48.307621    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-4cmph" podStartSLOduration=2.646829076 podStartE2EDuration="10.307557329s" totalImagesPullingTime="7.660728253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:48.101052748 +0000 UTC m=+10.747248143" watchObservedRunningTime="2026-10-30 20:38:48.307557329 +0000 UTC m=+10.953752728"
Oct 30 20:38:48.909183 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:48.908880    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:48.909605 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:48.909266    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:38:49.083205 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:49.083165    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zv2n9" event={"ID":"33b22c6f-4f13-4e54-9304-cfa57f52fbe1","Type":"ContainerStarted","Data":"ef816a23ea0f6db56e3751811acf37a3d61afa2c53b562f27996dbadb5c446ed"}
Oct 30 20:38:49.086987 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:49.086935    2586 generic.go:356] "Generic (PLEG): container finished" podID="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" containerID="6e9dd3232a12421a80a7004e6c24bb9d79c15af69037fe74a3d4de551d31cce0" exitCode=0
Oct 30 20:38:49.087137 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:49.087001    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnqc4" event={"ID":"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c","Type":"ContainerDied","Data":"6e9dd3232a12421a80a7004e6c24bb9d79c15af69037fe74a3d4de551d31cce0"}
Oct 30 20:38:49.090863 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:49.090839    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t" event={"ID":"c5071a82-ea2d-426c-83da-9eae94007232","Type":"ContainerStarted","Data":"eae9fb4936e4d56512361bafa61c79415b9b31f5afad2de00842efed6fe7a5e2"}
Oct 30 20:38:49.100577 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:49.100531    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-zv2n9" podStartSLOduration=3.253030976 podStartE2EDuration="11.100513873s" totalImagesPullingTime="7.847482897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:49.100130431 +0000 UTC m=+11.746325829" watchObservedRunningTime="2026-10-30 20:38:49.100513873 +0000 UTC m=+11.746709271"
Oct 30 20:38:49.122265 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:49.122219    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t" podStartSLOduration=2.97846864 podStartE2EDuration="11.122208374s" totalImagesPullingTime="8.143739734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:49.12182642 +0000 UTC m=+11.768021815" watchObservedRunningTime="2026-10-30 20:38:49.122208374 +0000 UTC m=+11.768403768"
Oct 30 20:38:49.909698 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:49.909659    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:49.910133 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:49.909673    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:49.910133 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:49.909833    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:38:49.910133 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:49.909920    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:38:50.093659 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:50.093620    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5qtnx" event={"ID":"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1","Type":"ContainerStarted","Data":"041515d435a585f3166b543e203667859b9f844ac8379d06948bf0e3a584c236"}
Oct 30 20:38:50.114864 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:50.114813    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5qtnx" podStartSLOduration=4.38228084 podStartE2EDuration="12.114795738s" totalImagesPullingTime="7.732514898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:50.11387561 +0000 UTC m=+12.760071005" watchObservedRunningTime="2026-10-30 20:38:50.114795738 +0000 UTC m=+12.760991134"
Oct 30 20:38:50.909396 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:50.909361    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:50.909563 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:50.909486    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:38:50.972095 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:50.972062    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:38:50.972666 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:50.972198    2586 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:38:50.972765 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:50.972737    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:38:51.097854 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:51.097817    2586 generic.go:356] "Generic (PLEG): container finished" podID="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" containerID="da8f455b1da7eb6734df8f13c8e52914a520291f4c5407998b51ee9e607a3d71" exitCode=0
Oct 30 20:38:51.098001 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:51.097897    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnqc4" event={"ID":"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c","Type":"ContainerDied","Data":"da8f455b1da7eb6734df8f13c8e52914a520291f4c5407998b51ee9e607a3d71"}
Oct 30 20:38:51.099840 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:51.099813    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zbxjw" event={"ID":"01fae3a3-8169-40f8-b7b8-d313c96b6add","Type":"ContainerStarted","Data":"1185dc405cc94bb4e8a256982d73aa52a07b2d342d6a90460ab6f390af03f030"}
Oct 30 20:38:51.141586 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:51.141531    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zbxjw" podStartSLOduration=3.036508474 podStartE2EDuration="13.141515962s" totalImagesPullingTime="10.105007488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:51.1412828 +0000 UTC m=+13.787478200" watchObservedRunningTime="2026-10-30 20:38:51.141515962 +0000 UTC m=+13.787711357"
Oct 30 20:38:51.910050 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:51.909891    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:51.910050 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:51.909893    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:51.910170 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:51.910049    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:38:51.910170 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:51.910118    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:38:52.105248 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:52.105154    2586 generic.go:356] "Generic (PLEG): container finished" podID="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" containerID="8532392a956a80da3fe0a87818b28454cc26bbca01af2dbc9f8390ad6631fcca" exitCode=0
Oct 30 20:38:52.105248 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:52.105185    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnqc4" event={"ID":"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c","Type":"ContainerDied","Data":"8532392a956a80da3fe0a87818b28454cc26bbca01af2dbc9f8390ad6631fcca"}
Oct 30 20:38:52.829286 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:52.829184    2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lvlkq_c6ef821a-391c-4775-9cf4-f54b1a4d247d/konnectivity-agent/0.log" limit=1024
Oct 30 20:38:52.909769 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:52.909725    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:52.909961 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:52.909866    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:38:53.909465 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:53.909206    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:53.909824 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:53.909546    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:38:53.909876 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:53.909275    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:53.909909 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:53.909898    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:38:54.725100 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:54.725051    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zv2n9_33b22c6f-4f13-4e54-9304-cfa57f52fbe1/dns-node-resolver/0.log"
Oct 30 20:38:54.909156 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:54.909125    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:54.909254 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:54.909235    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:38:55.115159 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.114961    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk" event={"ID":"fbd28ece-83af-4175-a32f-774fe77aae9f","Type":"ContainerStarted","Data":"5c571b0fcfb617d05685d096a2c015106f73c47346a70380d99845f2614ad403"}
Oct 30 20:38:55.115585 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.115192    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk" event={"ID":"fbd28ece-83af-4175-a32f-774fe77aae9f","Type":"ContainerStarted","Data":"5a7b7ae5db7219b8b7ef5bfc4ec49f000d661a3c65d7735fd08b520f677bd012"}
Oct 30 20:38:55.115585 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.115237    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk" event={"ID":"fbd28ece-83af-4175-a32f-774fe77aae9f","Type":"ContainerStarted","Data":"f0181c15581b97e902f515454ae13b522a3c9ce76896424fc5240abae664f2f6"}
Oct 30 20:38:55.115585 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.115276    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk" event={"ID":"fbd28ece-83af-4175-a32f-774fe77aae9f","Type":"ContainerStarted","Data":"0bd9cf18f865da86b160c698d867c496e3e1dde90255d5c69407b2327ef14661"}
Oct 30 20:38:55.115585 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.115307    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk" event={"ID":"fbd28ece-83af-4175-a32f-774fe77aae9f","Type":"ContainerStarted","Data":"959ee89d4f6618e244048bd1e8e5a3a972870e7c4e0cd5e12f31f4b514744752"}
Oct 30 20:38:55.115585 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.115342    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk" event={"ID":"fbd28ece-83af-4175-a32f-774fe77aae9f","Type":"ContainerStarted","Data":"922e6a46bfadf5e159f4d1a1837cf92b1aff5dd027beb41225e6455deff920d5"}
Oct 30 20:38:55.117680 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.117656    2586 generic.go:356] "Generic (PLEG): container finished" podID="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" containerID="e2f2dde36832146f138ff0c0dc6a389cf5760e096d1968e682c8bf63351db27d" exitCode=0
Oct 30 20:38:55.117785 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.117702    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnqc4" event={"ID":"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c","Type":"ContainerDied","Data":"e2f2dde36832146f138ff0c0dc6a389cf5760e096d1968e682c8bf63351db27d"}
Oct 30 20:38:55.493141 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.493107    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:55.493291 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:55.493273    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:55.493350 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:55.493338    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs podName:b3a3268c-635f-4eb2-a85d-f9c42a5d4db7 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:11.493323692 +0000 UTC m=+34.139519078 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs") pod "network-metrics-daemon-d4pmp" (UID: "b3a3268c-635f-4eb2-a85d-f9c42a5d4db7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:38:55.533662 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.533636    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-45j6n_840bcd20-c702-4818-8e4e-0caa0ae2ffe3/node-ca/0.log"
Oct 30 20:38:55.594356 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.594322    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:55.594482 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:55.594469    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:55.594538 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:55.594528    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret podName:c28bc8e0-d670-4b43-bab5-d51bdbe1a350 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:11.59451414 +0000 UTC m=+34.240709528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret") pod "global-pull-secret-syncer-8p5hf" (UID: "c28bc8e0-d670-4b43-bab5-d51bdbe1a350") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:38:55.694811 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.694772    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8474p\" (UniqueName: \"kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p\") pod \"network-check-target-g5cnl\" (UID: \"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5\") " pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:55.694948 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:55.694903    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:38:55.694948 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:55.694918    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:38:55.694948 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:55.694927    2586 projected.go:196] Error preparing data for projected volume kube-api-access-8474p for pod openshift-network-diagnostics/network-check-target-g5cnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:55.695077 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:55.694973    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p podName:1b3d2ec1-b5f3-499e-a5e2-b524d57837b5 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:11.694961349 +0000 UTC m=+34.341156721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8474p" (UniqueName: "kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p") pod "network-check-target-g5cnl" (UID: "1b3d2ec1-b5f3-499e-a5e2-b524d57837b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:38:55.909606 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.909571    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:55.909742 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:55.909691    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:38:55.909786 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:55.909739    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:55.909844 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:55.909827    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:38:56.122956 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:56.122923    2586 generic.go:356] "Generic (PLEG): container finished" podID="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" containerID="5ecd2c8b49c68534860ca83301da98b66fa82837cc212226a2011557e26367ab" exitCode=0
Oct 30 20:38:56.122956 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:56.122957    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnqc4" event={"ID":"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c","Type":"ContainerDied","Data":"5ecd2c8b49c68534860ca83301da98b66fa82837cc212226a2011557e26367ab"}
Oct 30 20:38:56.908949 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:56.908901    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:56.909123 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:56.909041    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:38:57.128760 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:57.128730    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk" event={"ID":"fbd28ece-83af-4175-a32f-774fe77aae9f","Type":"ContainerStarted","Data":"2cd635ad19a1d611ac82125069beeeb70ea0e28cb001324708cfbba86e32151f"}
Oct 30 20:38:57.132211 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:57.132179    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dnqc4" event={"ID":"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c","Type":"ContainerStarted","Data":"1b4d54650754ce02dc8ae2392426550714ae0524a177553c3f3e742e1976a290"}
Oct 30 20:38:57.177982 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:57.177898    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dnqc4" podStartSLOduration=8.017672857 podStartE2EDuration="19.177884979s" totalImagesPullingTime="11.160212122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:57.1777179 +0000 UTC m=+19.823913295" watchObservedRunningTime="2026-10-30 20:38:57.177884979 +0000 UTC m=+19.824080373"
Oct 30 20:38:57.909684 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:57.909646    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:57.909846 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:57.909737    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:38:57.909846 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:57.909774    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:57.909846 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:57.909834    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:38:58.909762 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:58.909731    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:38:58.910217 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:58.909839    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:38:59.912220 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:59.912194    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:38:59.912831 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:38:59.912198    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:38:59.912831 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:59.912288    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:38:59.912831 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:38:59.912358    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:39:00.142362 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:00.142328    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk" event={"ID":"fbd28ece-83af-4175-a32f-774fe77aae9f","Type":"ContainerStarted","Data":"49e5790a8c0500c3cb238e154b923aa039e581af2840e118a2e0d7ef93561449"}
Oct 30 20:39:00.143055 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:00.142560    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:00.157781 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:00.157755    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:00.176128 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:00.176054    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk" podStartSLOduration=7.606382226 podStartE2EDuration="22.176039914s" totalImagesPullingTime="14.569657688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:00.174851325 +0000 UTC m=+22.821046720" watchObservedRunningTime="2026-10-30 20:39:00.176039914 +0000 UTC m=+22.822235303"
Oct 30 20:39:00.909050 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:00.909007    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:00.909211 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:00.909118    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:39:01.144063 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:01.144014    2586 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:39:01.144451 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:01.144427    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:01.158705 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:01.158686    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:01.909783 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:01.909756    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:01.910008 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:01.909842    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:39:01.910008 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:01.909942    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:01.910125 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:01.910070    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:39:02.145933 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:02.145906    2586 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:39:02.909716 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:02.909690    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:02.909853 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:02.909783    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:39:03.148278 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:03.148252    2586 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:39:03.909314 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:03.909282    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:03.909497 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:03.909394    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:39:03.909497 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:03.909444    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:03.909574 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:03.909537    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:39:04.909206 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:04.909177    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:04.909655 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:04.909324    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:39:05.909180 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:05.908977    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:05.909499 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:05.909051    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:05.909499 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:05.909253    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:39:05.909499 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:05.909314    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:39:06.043717 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:06.043688    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:06.043895 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:06.043883    2586 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:39:06.058223 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:06.058187    2586 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk" podUID="fbd28ece-83af-4175-a32f-774fe77aae9f" containerName="ovnkube-controller" probeResult="failure" output=""
Oct 30 20:39:06.066461 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:06.066431    2586 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk" podUID="fbd28ece-83af-4175-a32f-774fe77aae9f" containerName="ovnkube-controller" probeResult="failure" output=""
Oct 30 20:39:06.909062 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:06.908998    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:06.909273 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:06.909162    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:39:07.910485 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:07.910456    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:07.910868 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:07.910543    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:39:07.910868 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:07.910593    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:07.910868 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:07.910677    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:39:08.909646 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:08.909617    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:08.909812 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:08.909710    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:39:09.905242 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:09.905205    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8p5hf"]
Oct 30 20:39:09.905753 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:09.905344    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:09.905753 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:09.905448    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:39:09.906996 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:09.906971    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g5cnl"]
Oct 30 20:39:09.907141 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:09.907112    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:09.907220 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:09.907198    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:39:09.916208 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:09.913443    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d4pmp"]
Oct 30 20:39:09.916208 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:09.913535    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:09.916208 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:09.913636    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:39:11.511772 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:11.511687    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:11.512162 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:11.511828    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:39:11.512162 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:11.511911    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs podName:b3a3268c-635f-4eb2-a85d-f9c42a5d4db7 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:43.511895464 +0000 UTC m=+66.158090837 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs") pod "network-metrics-daemon-d4pmp" (UID: "b3a3268c-635f-4eb2-a85d-f9c42a5d4db7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:39:11.612762 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:11.612728    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:11.612912 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:11.612871    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:39:11.612957 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:11.612926    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret podName:c28bc8e0-d670-4b43-bab5-d51bdbe1a350 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:43.612911999 +0000 UTC m=+66.259107373 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret") pod "global-pull-secret-syncer-8p5hf" (UID: "c28bc8e0-d670-4b43-bab5-d51bdbe1a350") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:39:11.713257 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:11.713227    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8474p\" (UniqueName: \"kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p\") pod \"network-check-target-g5cnl\" (UID: \"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5\") " pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:11.713408 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:11.713385    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:39:11.713408 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:11.713405    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:39:11.713499 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:11.713416    2586 projected.go:196] Error preparing data for projected volume kube-api-access-8474p for pod openshift-network-diagnostics/network-check-target-g5cnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:39:11.713499 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:11.713464    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p podName:1b3d2ec1-b5f3-499e-a5e2-b524d57837b5 nodeName:}" failed. No retries permitted until 2026-10-30 20:39:43.713451775 +0000 UTC m=+66.359647152 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8474p" (UniqueName: "kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p") pod "network-check-target-g5cnl" (UID: "1b3d2ec1-b5f3-499e-a5e2-b524d57837b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:39:11.909541 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:11.909514    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:11.909675 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:11.909545    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:11.909675 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:11.909518    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:11.909675 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:11.909646    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:39:11.909828 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:11.909709    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:39:11.909878 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:11.909821    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:39:13.909161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:13.909125    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:13.909161 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:13.909143    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:13.909712 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:13.909130    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:13.909712 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:13.909231    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g5cnl" podUID="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5"
Oct 30 20:39:13.909712 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:13.909308    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p5hf" podUID="c28bc8e0-d670-4b43-bab5-d51bdbe1a350"
Oct 30 20:39:13.909712 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:13.909396    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d4pmp" podUID="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7"
Oct 30 20:39:14.575881 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.575708    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeReady"
Oct 30 20:39:14.576042 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.575973    2586 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 20:39:14.626975 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.626951    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-44r9j"]
Oct 30 20:39:14.668148 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.668109    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wcfkv"]
Oct 30 20:39:14.668281 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.668228    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.672408 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.672387    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:39:14.672530 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.672483    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:39:14.672530 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.672513    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:39:14.676260 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.673041    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6gb67\""
Oct 30 20:39:14.676260 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.676088    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:39:14.684765 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.684745    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44r9j"]
Oct 30 20:39:14.684852 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.684781    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wcfkv"]
Oct 30 20:39:14.684909 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.684869    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wcfkv"
Oct 30 20:39:14.690264 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.690234    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:39:14.734600 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.734573    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bd9vt"]
Oct 30 20:39:14.762017 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.761993    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bd9vt"]
Oct 30 20:39:14.762133 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.762113    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:14.772544 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.772527    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:39:14.772628 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.772550    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:39:14.773143 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.773129    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:39:14.773383 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.773370    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gk5pt\""
Oct 30 20:39:14.773964 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.773951    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kxrnf\""
Oct 30 20:39:14.774034 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.774012    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:39:14.839634 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.839581    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99zv4\" (UniqueName: \"kubernetes.io/projected/241b828d-8324-467d-9f6b-ab0c3959b895-kube-api-access-99zv4\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.839634 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.839611    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lslgj\" (UniqueName: \"kubernetes.io/projected/06b08ffe-ca3b-4535-8563-567227a4af3e-kube-api-access-lslgj\") pod \"ingress-canary-wcfkv\" (UID: \"06b08ffe-ca3b-4535-8563-567227a4af3e\") " pod="openshift-ingress-canary/ingress-canary-wcfkv"
Oct 30 20:39:14.839778 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.839643    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/241b828d-8324-467d-9f6b-ab0c3959b895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.839778 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.839746    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/241b828d-8324-467d-9f6b-ab0c3959b895-crio-socket\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.839845 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.839829    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/241b828d-8324-467d-9f6b-ab0c3959b895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.839882 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.839846    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06b08ffe-ca3b-4535-8563-567227a4af3e-cert\") pod \"ingress-canary-wcfkv\" (UID: \"06b08ffe-ca3b-4535-8563-567227a4af3e\") " pod="openshift-ingress-canary/ingress-canary-wcfkv"
Oct 30 20:39:14.839919 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.839880    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/241b828d-8324-467d-9f6b-ab0c3959b895-data-volume\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.941202 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941175    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcvn9\" (UniqueName: \"kubernetes.io/projected/d26003df-46f0-4d7b-bd2c-b7fe898533cd-kube-api-access-dcvn9\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:14.941516 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941209    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99zv4\" (UniqueName: \"kubernetes.io/projected/241b828d-8324-467d-9f6b-ab0c3959b895-kube-api-access-99zv4\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.941516 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941234    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lslgj\" (UniqueName: \"kubernetes.io/projected/06b08ffe-ca3b-4535-8563-567227a4af3e-kube-api-access-lslgj\") pod \"ingress-canary-wcfkv\" (UID: \"06b08ffe-ca3b-4535-8563-567227a4af3e\") " pod="openshift-ingress-canary/ingress-canary-wcfkv"
Oct 30 20:39:14.941516 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941285    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d26003df-46f0-4d7b-bd2c-b7fe898533cd-tmp-dir\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:14.941516 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941394    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/241b828d-8324-467d-9f6b-ab0c3959b895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.941516 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941428    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d26003df-46f0-4d7b-bd2c-b7fe898533cd-metrics-tls\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:14.941516 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941458    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/241b828d-8324-467d-9f6b-ab0c3959b895-crio-socket\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.941516 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941485    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d26003df-46f0-4d7b-bd2c-b7fe898533cd-config-volume\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:14.941848 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941598    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/241b828d-8324-467d-9f6b-ab0c3959b895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.941848 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941624    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06b08ffe-ca3b-4535-8563-567227a4af3e-cert\") pod \"ingress-canary-wcfkv\" (UID: \"06b08ffe-ca3b-4535-8563-567227a4af3e\") " pod="openshift-ingress-canary/ingress-canary-wcfkv"
Oct 30 20:39:14.941848 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941661    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/241b828d-8324-467d-9f6b-ab0c3959b895-crio-socket\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.941848 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941669    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/241b828d-8324-467d-9f6b-ab0c3959b895-data-volume\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.942050 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.941987    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/241b828d-8324-467d-9f6b-ab0c3959b895-data-volume\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.942359 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.942340    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/241b828d-8324-467d-9f6b-ab0c3959b895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.945348 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.945331    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/241b828d-8324-467d-9f6b-ab0c3959b895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:14.945481 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.945464    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06b08ffe-ca3b-4535-8563-567227a4af3e-cert\") pod \"ingress-canary-wcfkv\" (UID: \"06b08ffe-ca3b-4535-8563-567227a4af3e\") " pod="openshift-ingress-canary/ingress-canary-wcfkv"
Oct 30 20:39:14.956174 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.956150    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lslgj\" (UniqueName: \"kubernetes.io/projected/06b08ffe-ca3b-4535-8563-567227a4af3e-kube-api-access-lslgj\") pod \"ingress-canary-wcfkv\" (UID: \"06b08ffe-ca3b-4535-8563-567227a4af3e\") " pod="openshift-ingress-canary/ingress-canary-wcfkv"
Oct 30 20:39:14.956753 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:14.956732    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99zv4\" (UniqueName: \"kubernetes.io/projected/241b828d-8324-467d-9f6b-ab0c3959b895-kube-api-access-99zv4\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:15.004653 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.004631    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:15.009985 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.009965    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"]
Oct 30 20:39:15.012127 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.012111    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wcfkv"
Oct 30 20:39:15.032402 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.032380    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"]
Oct 30 20:39:15.032520 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.032506    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.039915 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.039893    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:39:15.040006 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.039912    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:39:15.040253 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.040224    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 20:39:15.040309 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.040264    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 20:39:15.040309 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.040294    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zvmst\""
Oct 30 20:39:15.040375 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.040348    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 20:39:15.042758 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.042735    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d26003df-46f0-4d7b-bd2c-b7fe898533cd-tmp-dir\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:15.042841 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.042791    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d26003df-46f0-4d7b-bd2c-b7fe898533cd-metrics-tls\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:15.042841 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.042820    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d26003df-46f0-4d7b-bd2c-b7fe898533cd-config-volume\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:15.042936 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.042894    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcvn9\" (UniqueName: \"kubernetes.io/projected/d26003df-46f0-4d7b-bd2c-b7fe898533cd-kube-api-access-dcvn9\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:15.043162 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.043143    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d26003df-46f0-4d7b-bd2c-b7fe898533cd-tmp-dir\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:15.043470 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.043449    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d26003df-46f0-4d7b-bd2c-b7fe898533cd-config-volume\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:15.045137 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.045122    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d26003df-46f0-4d7b-bd2c-b7fe898533cd-metrics-tls\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:15.057795 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.057767    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcvn9\" (UniqueName: \"kubernetes.io/projected/d26003df-46f0-4d7b-bd2c-b7fe898533cd-kube-api-access-dcvn9\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:15.095749 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.095679    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:15.144012 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.143833    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.144012 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.143893    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.144012 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.143932    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.144012 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.143955    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl7sk\" (UniqueName: \"kubernetes.io/projected/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-kube-api-access-dl7sk\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.244524 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.244485    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.244524 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.244522    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.244708 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.244550    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.244708 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.244567    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl7sk\" (UniqueName: \"kubernetes.io/projected/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-kube-api-access-dl7sk\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.245242 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.245222    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.247169 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.247147    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.247262 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.247185    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.257414 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.257395    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl7sk\" (UniqueName: \"kubernetes.io/projected/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-kube-api-access-dl7sk\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.363616 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.363551    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wcfkv"]
Oct 30 20:39:15.365693 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.365672    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:15.367168 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.367145    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44r9j"]
Oct 30 20:39:15.367628 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:15.367592    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b08ffe_ca3b_4535_8563_567227a4af3e.slice/crio-dd7ad502ab0f589a77b9964bbf0f0b218ba7cf827da748a4434d078164a3e9c4 WatchSource:0}: Error finding container dd7ad502ab0f589a77b9964bbf0f0b218ba7cf827da748a4434d078164a3e9c4: Status 404 returned error can't find the container with id dd7ad502ab0f589a77b9964bbf0f0b218ba7cf827da748a4434d078164a3e9c4
Oct 30 20:39:15.370839 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:15.370817    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241b828d_8324_467d_9f6b_ab0c3959b895.slice/crio-189329a83c01a187b71d6763260eeceb5bafb600d957eb1c87299431e7b8dace WatchSource:0}: Error finding container 189329a83c01a187b71d6763260eeceb5bafb600d957eb1c87299431e7b8dace: Status 404 returned error can't find the container with id 189329a83c01a187b71d6763260eeceb5bafb600d957eb1c87299431e7b8dace
Oct 30 20:39:15.387508 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.387485    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bd9vt"]
Oct 30 20:39:15.394263 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:15.394241    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26003df_46f0_4d7b_bd2c_b7fe898533cd.slice/crio-ba3c1bbd08e26604ed7728f99e16ccad1abb1378d83d851805e57f2e8d372276 WatchSource:0}: Error finding container ba3c1bbd08e26604ed7728f99e16ccad1abb1378d83d851805e57f2e8d372276: Status 404 returned error can't find the container with id ba3c1bbd08e26604ed7728f99e16ccad1abb1378d83d851805e57f2e8d372276
Oct 30 20:39:15.652539 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.652270    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"]
Oct 30 20:39:15.655745 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:15.655713    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81bbb61_4901_4f5b_91ec_ec15ae1fdc74.slice/crio-5638334c773411572ebc8b8f1b9175ba85ae8448c51b8704b7d40db55b4ecffa WatchSource:0}: Error finding container 5638334c773411572ebc8b8f1b9175ba85ae8448c51b8704b7d40db55b4ecffa: Status 404 returned error can't find the container with id 5638334c773411572ebc8b8f1b9175ba85ae8448c51b8704b7d40db55b4ecffa
Oct 30 20:39:15.909042 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.908945    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:15.909042 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.909014    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:15.909042 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.909012    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:15.913423 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.913363    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:39:15.913423 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.913375    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:39:15.914793 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.914771    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:39:15.914793 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.914775    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6zzqh\""
Oct 30 20:39:15.914793 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.914802    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:39:15.915047 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.914775    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-r8zbf\""
Oct 30 20:39:15.915047 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:15.914865    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-q55wr\""
Oct 30 20:39:16.177873 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:16.177678    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44r9j" event={"ID":"241b828d-8324-467d-9f6b-ab0c3959b895","Type":"ContainerStarted","Data":"089e6e344f88a5741e41cdd35df8d1b91984ac71fcf34e3b599658cc8b6fe48d"}
Oct 30 20:39:16.177873 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:16.177788    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44r9j" event={"ID":"241b828d-8324-467d-9f6b-ab0c3959b895","Type":"ContainerStarted","Data":"189329a83c01a187b71d6763260eeceb5bafb600d957eb1c87299431e7b8dace"}
Oct 30 20:39:16.179275 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:16.179237    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bd9vt" event={"ID":"d26003df-46f0-4d7b-bd2c-b7fe898533cd","Type":"ContainerStarted","Data":"ba3c1bbd08e26604ed7728f99e16ccad1abb1378d83d851805e57f2e8d372276"}
Oct 30 20:39:16.180833 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:16.180774    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj" event={"ID":"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74","Type":"ContainerStarted","Data":"5638334c773411572ebc8b8f1b9175ba85ae8448c51b8704b7d40db55b4ecffa"}
Oct 30 20:39:16.182532 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:16.182507    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wcfkv" event={"ID":"06b08ffe-ca3b-4535-8563-567227a4af3e","Type":"ContainerStarted","Data":"dd7ad502ab0f589a77b9964bbf0f0b218ba7cf827da748a4434d078164a3e9c4"}
Oct 30 20:39:17.188832 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:17.188792    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44r9j" event={"ID":"241b828d-8324-467d-9f6b-ab0c3959b895","Type":"ContainerStarted","Data":"81594f17e81639e568fc92ba01697893a41fb302b947caf4c3de9ce99dae7ccd"}
Oct 30 20:39:18.193890 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:18.193852    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bd9vt" event={"ID":"d26003df-46f0-4d7b-bd2c-b7fe898533cd","Type":"ContainerStarted","Data":"b90981a5263be46e209f1be9ed0d8f12bad9dd5efeba90f2b1de24931640b9a8"}
Oct 30 20:39:18.197276 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:18.197219    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj" event={"ID":"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74","Type":"ContainerStarted","Data":"025f54cbc1245c02ee614bd955806cdcc557b2be0c6e01d4e55e4af6c549169a"}
Oct 30 20:39:18.197276 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:18.197282    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj" event={"ID":"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74","Type":"ContainerStarted","Data":"8b30878b916cf4bd1ccf8655123507fb23821a9ba22211554540b74f6f1b20e3"}
Oct 30 20:39:18.219379 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:18.219093    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj" podStartSLOduration=2.21626263 podStartE2EDuration="4.219073214s" totalImagesPullingTime="2.002810584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:18.218345398 +0000 UTC m=+40.864540812" watchObservedRunningTime="2026-10-30 20:39:18.219073214 +0000 UTC m=+40.865268608"
Oct 30 20:39:19.202144 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:19.201837    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wcfkv" event={"ID":"06b08ffe-ca3b-4535-8563-567227a4af3e","Type":"ContainerStarted","Data":"e262fef90548a590c8f6cd0b52ec5e9d432f7737a7417e8d0a715ae7b94b8527"}
Oct 30 20:39:19.203992 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:19.203967    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44r9j" event={"ID":"241b828d-8324-467d-9f6b-ab0c3959b895","Type":"ContainerStarted","Data":"0bfccf4790173cb29c3267b5bce7ff9318eadfcbb7e1da4c0883d8fea224bc60"}
Oct 30 20:39:19.205807 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:19.205783    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bd9vt" event={"ID":"d26003df-46f0-4d7b-bd2c-b7fe898533cd","Type":"ContainerStarted","Data":"523491c8ad00a0da4a827ae916592414fa167ea14cb7b79b9a114811ea611fe1"}
Oct 30 20:39:19.220448 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:19.220353    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wcfkv" podStartSLOduration=1.683568793 podStartE2EDuration="5.22033727s" totalImagesPullingTime="3.536768477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:19.21992688 +0000 UTC m=+41.866122295" watchObservedRunningTime="2026-10-30 20:39:19.22033727 +0000 UTC m=+41.866532667"
Oct 30 20:39:19.241425 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:19.241376    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-44r9j" podStartSLOduration=1.9239264139999999 podStartE2EDuration="5.241362003s" totalImagesPullingTime="3.317435589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:39:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:19.240551632 +0000 UTC m=+41.886747048" watchObservedRunningTime="2026-10-30 20:39:19.241362003 +0000 UTC m=+41.887557398"
Oct 30 20:39:19.266266 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:19.266219    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-bd9vt" podStartSLOduration=2.660589294 podStartE2EDuration="5.266205815s" totalImagesPullingTime="2.605616521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:19.265100297 +0000 UTC m=+41.911295711" watchObservedRunningTime="2026-10-30 20:39:19.266205815 +0000 UTC m=+41.912401200"
Oct 30 20:39:20.210965 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.210597    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:20.511998 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.511917    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"]
Oct 30 20:39:20.542250 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.542216    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"]
Oct 30 20:39:20.542403 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.542348    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.558210 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.558184    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"]
Oct 30 20:39:20.558354 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.558223    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"]
Oct 30 20:39:20.558354 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.558317    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.558354 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.558348    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x5lps"]
Oct 30 20:39:20.586730 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.582433    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.586996 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.586970    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 20:39:20.587128 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.586994    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 20:39:20.587128 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.587070    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 20:39:20.587128 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.587081    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-85g6n\""
Oct 30 20:39:20.587285 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.587185    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 20:39:20.587335 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.587287    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-82zqq\""
Oct 30 20:39:20.599583 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.599565    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 20:39:20.599911 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.599899    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rmftm\""
Oct 30 20:39:20.600118 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.600104    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 20:39:20.650916 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.650892    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 20:39:20.651053 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.650937    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 20:39:20.689369 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689344    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.689517 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689374    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.689517 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689398    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-root\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.689517 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689414    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-tls\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.689517 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689483    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.689696 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689597    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3510fa5-8b88-4b4d-893a-f3dca0163e72-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.689748 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689717    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-metrics-client-ca\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.689800 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689753    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.689800 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689781    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6c2k\" (UniqueName: \"kubernetes.io/projected/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-api-access-x6c2k\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.689871 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689825    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.689871 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689846    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a3510fa5-8b88-4b4d-893a-f3dca0163e72-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.689871 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689864    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnqtl\" (UniqueName: \"kubernetes.io/projected/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-kube-api-access-bnqtl\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.690011 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689881    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69v72\" (UniqueName: \"kubernetes.io/projected/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-kube-api-access-69v72\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.690011 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689930    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-sys\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.690011 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.689979    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.690175 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.690045    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.690175 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.690072    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-wtmp\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.690175 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.690143    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.690306 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.690210    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-textfile\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.791260 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791191    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-metrics-client-ca\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.791260 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791225    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.791260 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791245    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6c2k\" (UniqueName: \"kubernetes.io/projected/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-api-access-x6c2k\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.791260 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791263    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.791550 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791288    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a3510fa5-8b88-4b4d-893a-f3dca0163e72-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.791550 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791319    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnqtl\" (UniqueName: \"kubernetes.io/projected/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-kube-api-access-bnqtl\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.791550 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791344    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69v72\" (UniqueName: \"kubernetes.io/projected/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-kube-api-access-69v72\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.791550 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791369    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-sys\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.791550 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791396    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.791550 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791422    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.791550 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791444    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-wtmp\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.791550 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791468    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.791550 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791527    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-textfile\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.791966 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791554    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.791966 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791585    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-sys\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.791966 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791602    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.791966 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791641    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-root\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.791966 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791666    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-tls\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.791966 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791706    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.791966 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791737    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3510fa5-8b88-4b4d-893a-f3dca0163e72-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.791966 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791768    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a3510fa5-8b88-4b4d-893a-f3dca0163e72-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.791966 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.791947    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-metrics-client-ca\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.792447 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.792147    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-wtmp\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.792447 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.792391    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-textfile\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.792447 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.792442    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3510fa5-8b88-4b4d-893a-f3dca0163e72-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.792582 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.792442    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.792582 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.792556    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-root\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.792700 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.792677    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.792917 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.792877    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.797472 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.797450    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.797570 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.797477    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.797570 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.797481    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-tls\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.797570 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.797517    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.797570 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.797507    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.797570 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.797535    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.803966 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.803946    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6c2k\" (UniqueName: \"kubernetes.io/projected/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-api-access-x6c2k\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:20.804352 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.804332    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnqtl\" (UniqueName: \"kubernetes.io/projected/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-kube-api-access-bnqtl\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.804427 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.804361    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69v72\" (UniqueName: \"kubernetes.io/projected/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-kube-api-access-69v72\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.902883 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.902859    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:20.973437 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.973413    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:20.991575 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:20.991550    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:21.005976 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:21.005943    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef23080_50af_4c4e_9cba_64a5c85fc4ac.slice/crio-49fec735c0078506dcadfb5469460fa04e272165bdb1b449697d8a8e2595f925 WatchSource:0}: Error finding container 49fec735c0078506dcadfb5469460fa04e272165bdb1b449697d8a8e2595f925: Status 404 returned error can't find the container with id 49fec735c0078506dcadfb5469460fa04e272165bdb1b449697d8a8e2595f925
Oct 30 20:39:21.210108 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.210083    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"]
Oct 30 20:39:21.212825 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:21.212790    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bd3b39_32fc_4092_a1ec_911f4a86bd7d.slice/crio-9fc4adb92295d4e6016e7340547e48bb93dcea8c49a70a47e932b7d15dce8468 WatchSource:0}: Error finding container 9fc4adb92295d4e6016e7340547e48bb93dcea8c49a70a47e932b7d15dce8468: Status 404 returned error can't find the container with id 9fc4adb92295d4e6016e7340547e48bb93dcea8c49a70a47e932b7d15dce8468
Oct 30 20:39:21.214083 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.214017    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5lps" event={"ID":"0ef23080-50af-4c4e-9cba-64a5c85fc4ac","Type":"ContainerStarted","Data":"49fec735c0078506dcadfb5469460fa04e272165bdb1b449697d8a8e2595f925"}
Oct 30 20:39:21.288122 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.288097    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"]
Oct 30 20:39:21.290131 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:21.290109    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3510fa5_8b88_4b4d_893a_f3dca0163e72.slice/crio-75d9beb7d1bcd1538d136a4338682fdf81d5288863335220f95e353300476cc9 WatchSource:0}: Error finding container 75d9beb7d1bcd1538d136a4338682fdf81d5288863335220f95e353300476cc9: Status 404 returned error can't find the container with id 75d9beb7d1bcd1538d136a4338682fdf81d5288863335220f95e353300476cc9
Oct 30 20:39:21.558989 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.558959    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:39:21.570190 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.569521    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.575047 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.574981    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 20:39:21.585690 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.585667    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hjsfp\""
Oct 30 20:39:21.585807 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.585758    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 20:39:21.585893 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.585821    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 20:39:21.586502 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.585937    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 20:39:21.586502 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.585992    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 20:39:21.586502 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.586098    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 20:39:21.586502 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.586131    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:39:21.586502 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.586163    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 20:39:21.586502 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.586218    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 20:39:21.586502 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.586339    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 20:39:21.599984 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.599957    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.600126 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.599996    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-web-config\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.600126 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.600048    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.600126 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.600072    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.600126 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.600088    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-config-volume\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.600126 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.600102    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.600126 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.600126    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-config-out\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.600382 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.600189    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.600382 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.600261    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.600382 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.600293    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.600382 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.600326    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk5nj\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-kube-api-access-wk5nj\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.600382 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.600355    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.600551 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.600405    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.701656 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701623    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.701656 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701659    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-web-config\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.701851 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701681    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.701851 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701704    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.701851 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701728    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-config-volume\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.701851 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701743    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.701851 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701760    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-config-out\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.701851 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701790    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.701851 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701835    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.702075 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701857    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.702075 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701876    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk5nj\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-kube-api-access-wk5nj\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.702075 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701893    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.702075 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.701915    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.703258 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.703229    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.703456 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.703440    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.703530 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.703512    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.706009 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.705982    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.706157 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.706081    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.706229 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.706165    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-web-config\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.706280 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.706250    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-config-out\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.706280 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.706262    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.707056 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.706988    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.707601 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.707580    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-config-volume\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.707667 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.707621    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.708327 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.708303    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.716278 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.716241    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk5nj\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-kube-api-access-wk5nj\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:21.919541 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:21.919472    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:22.221013 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.220936    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t" event={"ID":"a3510fa5-8b88-4b4d-893a-f3dca0163e72","Type":"ContainerStarted","Data":"75d9beb7d1bcd1538d136a4338682fdf81d5288863335220f95e353300476cc9"}
Oct 30 20:39:22.225170 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.225138    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg" event={"ID":"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d","Type":"ContainerStarted","Data":"96c71f60cb38eae2d1936d3a49b63f3cacf8f2f6f62a0bf1d9c0c57a01b96060"}
Oct 30 20:39:22.225312 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.225197    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg" event={"ID":"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d","Type":"ContainerStarted","Data":"7d189aeac374312314d6f36ecb8ef360c444b002eff72a62cd0f589b3f2520dc"}
Oct 30 20:39:22.225312 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.225221    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg" event={"ID":"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d","Type":"ContainerStarted","Data":"9fc4adb92295d4e6016e7340547e48bb93dcea8c49a70a47e932b7d15dce8468"}
Oct 30 20:39:22.228631 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.228610    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:39:22.293584 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:22.293545    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda732d54f_3a00_454c_a2b6_202acda05e1a.slice/crio-783f50999e1d0aa329095c4dd094ec456f66bb8c17988ca603eeae80f7aedecf WatchSource:0}: Error finding container 783f50999e1d0aa329095c4dd094ec456f66bb8c17988ca603eeae80f7aedecf: Status 404 returned error can't find the container with id 783f50999e1d0aa329095c4dd094ec456f66bb8c17988ca603eeae80f7aedecf
Oct 30 20:39:22.454730 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.454462    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"]
Oct 30 20:39:22.466466 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.466441    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.476578 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.476366    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wlqc8\""
Oct 30 20:39:22.476946 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.476716    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"]
Oct 30 20:39:22.476946 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.476793    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 20:39:22.477226 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.476970    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 20:39:22.477226 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.476981    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 20:39:22.477226 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.477077    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 20:39:22.477226 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.477081    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 20:39:22.477490 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.477454    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b234hd2ptmdnb\""
Oct 30 20:39:22.509100 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.508995    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e77e6b22-b7c0-4053-a277-baf7073c6b54-metrics-client-ca\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.509351 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.509321    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-grpc-tls\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.509439 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.509418    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e77e6b22-b7c0-4053-a277-baf7073c6b54-tmp\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.509567 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.509525    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.509686 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.509628    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckzzb\" (UniqueName: \"kubernetes.io/projected/e77e6b22-b7c0-4053-a277-baf7073c6b54-kube-api-access-ckzzb\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.509746 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.509708    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.509746 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.509734    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.509844 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.509766    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.509844 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.509793    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-tls\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.610741 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.610708    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e77e6b22-b7c0-4053-a277-baf7073c6b54-metrics-client-ca\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.610741 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.610747    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-grpc-tls\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.610982 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.610773    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e77e6b22-b7c0-4053-a277-baf7073c6b54-tmp\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.610982 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.610821    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.610982 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.610865    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzzb\" (UniqueName: \"kubernetes.io/projected/e77e6b22-b7c0-4053-a277-baf7073c6b54-kube-api-access-ckzzb\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.610982 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.610910    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.610982 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.610928    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.610982 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.610966    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.611295 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.610989    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-tls\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.612347 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.612317    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e77e6b22-b7c0-4053-a277-baf7073c6b54-tmp\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.612581 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.612535    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e77e6b22-b7c0-4053-a277-baf7073c6b54-metrics-client-ca\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.614849 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.614807    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.615002 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.614980    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.615157 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.615134    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.615518 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.615493    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-grpc-tls\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.616285 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.616268    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-tls\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.616732 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.616708    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.624620 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.624601    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckzzb\" (UniqueName: \"kubernetes.io/projected/e77e6b22-b7c0-4053-a277-baf7073c6b54-kube-api-access-ckzzb\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:22.846885 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:22.846859    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:23.148488 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:23.148459    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"]
Oct 30 20:39:23.157242 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:23.157212    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode77e6b22_b7c0_4053_a277_baf7073c6b54.slice/crio-d7cf877aa3e82e6f4e9180c58c4e48247012fd932f39f063b09d902f9007a03d WatchSource:0}: Error finding container d7cf877aa3e82e6f4e9180c58c4e48247012fd932f39f063b09d902f9007a03d: Status 404 returned error can't find the container with id d7cf877aa3e82e6f4e9180c58c4e48247012fd932f39f063b09d902f9007a03d
Oct 30 20:39:23.231237 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:23.230899    2586 generic.go:356] "Generic (PLEG): container finished" podID="0ef23080-50af-4c4e-9cba-64a5c85fc4ac" containerID="e05ba66986e03318782c87969f63a401bc91d3052fb2815412eb9ca303981fe9" exitCode=0
Oct 30 20:39:23.231237 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:23.231090    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5lps" event={"ID":"0ef23080-50af-4c4e-9cba-64a5c85fc4ac","Type":"ContainerDied","Data":"e05ba66986e03318782c87969f63a401bc91d3052fb2815412eb9ca303981fe9"}
Oct 30 20:39:23.232792 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:23.232766    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx" event={"ID":"e77e6b22-b7c0-4053-a277-baf7073c6b54","Type":"ContainerStarted","Data":"d7cf877aa3e82e6f4e9180c58c4e48247012fd932f39f063b09d902f9007a03d"}
Oct 30 20:39:23.234332 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:23.234304    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerStarted","Data":"783f50999e1d0aa329095c4dd094ec456f66bb8c17988ca603eeae80f7aedecf"}
Oct 30 20:39:23.236238 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:23.236213    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t" event={"ID":"a3510fa5-8b88-4b4d-893a-f3dca0163e72","Type":"ContainerStarted","Data":"6cb797d853b0d22ba8867fcb844c59005375d0e135333e20f59619127917f9b8"}
Oct 30 20:39:23.238895 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:23.238861    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg" event={"ID":"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d","Type":"ContainerStarted","Data":"c2aeaaaa28f549d3589f7e06ab1fc16924edd01455a6d04969ee913bc924756d"}
Oct 30 20:39:23.279967 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:23.279154    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg" podStartSLOduration=1.908015011 podStartE2EDuration="3.279135031s" totalImagesPullingTime="1.37112002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:23.277942958 +0000 UTC m=+45.924138354" watchObservedRunningTime="2026-10-30 20:39:23.279135031 +0000 UTC m=+45.925330427"
Oct 30 20:39:24.245643 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:24.245540    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5lps" event={"ID":"0ef23080-50af-4c4e-9cba-64a5c85fc4ac","Type":"ContainerStarted","Data":"cfaa60c19e8d6e63f1a107afbaf6a1521c05f4cb441c8f2b93426f8ed8282575"}
Oct 30 20:39:24.245643 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:24.245602    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5lps" event={"ID":"0ef23080-50af-4c4e-9cba-64a5c85fc4ac","Type":"ContainerStarted","Data":"11d9e95fb38aa51953abf0cd61db7b701c6d2e65e871824f790c645ad21de89f"}
Oct 30 20:39:24.248015 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:24.247984    2586 generic.go:356] "Generic (PLEG): container finished" podID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerID="345c7fc8a42a3e7c6578d00692ddde108c65629204a66c7276204938f496ff62" exitCode=0
Oct 30 20:39:24.248380 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:24.248304    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerDied","Data":"345c7fc8a42a3e7c6578d00692ddde108c65629204a66c7276204938f496ff62"}
Oct 30 20:39:24.252066 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:24.252041    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t" event={"ID":"a3510fa5-8b88-4b4d-893a-f3dca0163e72","Type":"ContainerStarted","Data":"117f169e0c0291fb71788f9b5e9cbe53355210c05f91d9536ea1058dc2043dd4"}
Oct 30 20:39:24.252173 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:24.252092    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t" event={"ID":"a3510fa5-8b88-4b4d-893a-f3dca0163e72","Type":"ContainerStarted","Data":"2a2728ee59db492ae9a1bb738d219817155f4cf2f7dffaa25c36b08a584624a6"}
Oct 30 20:39:24.269259 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:24.269215    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x5lps" podStartSLOduration=2.871822994 podStartE2EDuration="4.269204044s" totalImagesPullingTime="1.308788082s" totalInitContainerRuntime="88.592968ms" isStatefulPod=true podCreationTimestamp="2026-10-30 20:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:24.268274485 +0000 UTC m=+46.914469879" watchObservedRunningTime="2026-10-30 20:39:24.269204044 +0000 UTC m=+46.915399439"
Oct 30 20:39:24.296696 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:24.296635    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t" podStartSLOduration=2.464196525 podStartE2EDuration="4.296620685s" totalImagesPullingTime="1.83242416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:24.295807316 +0000 UTC m=+46.942002738" watchObservedRunningTime="2026-10-30 20:39:24.296620685 +0000 UTC m=+46.942816075"
Oct 30 20:39:25.005143 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.005108    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-59bcb84677-sjv66"]
Oct 30 20:39:25.007236 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.007215    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.012545 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.012508    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 20:39:25.014170 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.014128    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 20:39:25.021246 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.021187    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59bcb84677-sjv66"]
Oct 30 20:39:25.024999 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.024978    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 20:39:25.026439 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.026383    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-s3n8t903060b\""
Oct 30 20:39:25.026439 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.026409    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 20:39:25.026439 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.026428    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-h47d2\""
Oct 30 20:39:25.036074 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.036047    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/664f00cf-cee9-45ed-9af7-52c78892a6dd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.036186 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.036141    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/664f00cf-cee9-45ed-9af7-52c78892a6dd-audit-log\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.036366 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.036242    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-secret-metrics-server-tls\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.036366 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.036281    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/664f00cf-cee9-45ed-9af7-52c78892a6dd-metrics-server-audit-profiles\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.036366 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.036354    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-client-ca-bundle\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.036486 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.036413    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmzqj\" (UniqueName: \"kubernetes.io/projected/664f00cf-cee9-45ed-9af7-52c78892a6dd-kube-api-access-lmzqj\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.036486 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.036467    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-secret-metrics-server-client-certs\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.138309 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.137222    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/664f00cf-cee9-45ed-9af7-52c78892a6dd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.138309 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.137336    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/664f00cf-cee9-45ed-9af7-52c78892a6dd-audit-log\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.138309 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.137383    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-secret-metrics-server-tls\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.138309 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.137405    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/664f00cf-cee9-45ed-9af7-52c78892a6dd-metrics-server-audit-profiles\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.138309 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.137420    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-client-ca-bundle\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.138309 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.137452    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmzqj\" (UniqueName: \"kubernetes.io/projected/664f00cf-cee9-45ed-9af7-52c78892a6dd-kube-api-access-lmzqj\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.138309 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.137495    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-secret-metrics-server-client-certs\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.139437 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.139376    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/664f00cf-cee9-45ed-9af7-52c78892a6dd-audit-log\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.139596 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.139566    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/664f00cf-cee9-45ed-9af7-52c78892a6dd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.140111 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.140076    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/664f00cf-cee9-45ed-9af7-52c78892a6dd-metrics-server-audit-profiles\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.143165 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.142862    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-client-ca-bundle\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.143165 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.143126    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-secret-metrics-server-tls\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.143877 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.143821    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-secret-metrics-server-client-certs\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.152392 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.152349    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmzqj\" (UniqueName: \"kubernetes.io/projected/664f00cf-cee9-45ed-9af7-52c78892a6dd-kube-api-access-lmzqj\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.186447 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.186422    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"]
Oct 30 20:39:25.189841 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.189279    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:25.199685 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.199623    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"]
Oct 30 20:39:25.224790 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.224759    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 20:39:25.225057 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.225035    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-795h6\""
Oct 30 20:39:25.238018 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.237990    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c44dq\" (UniqueName: \"kubernetes.io/projected/18026b97-bf3c-49e4-8745-98869d8e1af2-kube-api-access-c44dq\") pod \"monitoring-plugin-77f4f76594-pfxgr\" (UID: \"18026b97-bf3c-49e4-8745-98869d8e1af2\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:25.238206 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.238187    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18026b97-bf3c-49e4-8745-98869d8e1af2-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pfxgr\" (UID: \"18026b97-bf3c-49e4-8745-98869d8e1af2\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:25.321230 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.321201    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:25.341765 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.339587    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c44dq\" (UniqueName: \"kubernetes.io/projected/18026b97-bf3c-49e4-8745-98869d8e1af2-kube-api-access-c44dq\") pod \"monitoring-plugin-77f4f76594-pfxgr\" (UID: \"18026b97-bf3c-49e4-8745-98869d8e1af2\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:25.341765 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.339808    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18026b97-bf3c-49e4-8745-98869d8e1af2-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pfxgr\" (UID: \"18026b97-bf3c-49e4-8745-98869d8e1af2\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:25.344937 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.344911    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18026b97-bf3c-49e4-8745-98869d8e1af2-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pfxgr\" (UID: \"18026b97-bf3c-49e4-8745-98869d8e1af2\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:25.355463 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.355433    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c44dq\" (UniqueName: \"kubernetes.io/projected/18026b97-bf3c-49e4-8745-98869d8e1af2-kube-api-access-c44dq\") pod \"monitoring-plugin-77f4f76594-pfxgr\" (UID: \"18026b97-bf3c-49e4-8745-98869d8e1af2\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:25.507388 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.507364    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:25.609885 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.609864    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59bcb84677-sjv66"]
Oct 30 20:39:25.612495 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:25.612470    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664f00cf_cee9_45ed_9af7_52c78892a6dd.slice/crio-7d0f9e3213022ec7022b9292b9f7ce51d35bf02ff1dbbf303b1236fc83eebab9 WatchSource:0}: Error finding container 7d0f9e3213022ec7022b9292b9f7ce51d35bf02ff1dbbf303b1236fc83eebab9: Status 404 returned error can't find the container with id 7d0f9e3213022ec7022b9292b9f7ce51d35bf02ff1dbbf303b1236fc83eebab9
Oct 30 20:39:25.800056 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.798640    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"]
Oct 30 20:39:25.800056 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.799732    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75d988bc69-vl9jp"]
Oct 30 20:39:25.801824 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:25.801798    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18026b97_bf3c_49e4_8745_98869d8e1af2.slice/crio-5f63bad1d8f45285176f20bcf7a74703ad763d136a1209e98e80c1dff56aedf9 WatchSource:0}: Error finding container 5f63bad1d8f45285176f20bcf7a74703ad763d136a1209e98e80c1dff56aedf9: Status 404 returned error can't find the container with id 5f63bad1d8f45285176f20bcf7a74703ad763d136a1209e98e80c1dff56aedf9
Oct 30 20:39:25.802515 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.802460    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.808498 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.808477    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 20:39:25.813310 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.813284    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 20:39:25.818083 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.817904    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 20:39:25.818083 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.817986    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 20:39:25.818083 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.818002    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 20:39:25.818083 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.818076    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nhl26\""
Oct 30 20:39:25.818284 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.818121    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 20:39:25.819130 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.819059    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75d988bc69-vl9jp"]
Oct 30 20:39:25.843989 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.843920    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-federate-client-tls\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.844185 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.843987    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-serving-certs-ca-bundle\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.844185 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.844058    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.844185 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.844089    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-metrics-client-ca\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.844185 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.844116    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8h7s\" (UniqueName: \"kubernetes.io/projected/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-kube-api-access-z8h7s\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.844185 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.844173    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-secret-telemeter-client\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.844378 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.844222    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.844378 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.844276    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-telemeter-client-tls\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.945563 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.945530    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-secret-telemeter-client\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.945669 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.945581    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.945669 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.945657    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-telemeter-client-tls\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.945771 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.945720    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-federate-client-tls\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.945819 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.945772    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-serving-certs-ca-bundle\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.945819 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.945800    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.945964 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.945832    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-metrics-client-ca\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.945964 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.945860    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8h7s\" (UniqueName: \"kubernetes.io/projected/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-kube-api-access-z8h7s\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.946823 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.946795    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-serving-certs-ca-bundle\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.947230 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.947207    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.949058 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.947837    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-metrics-client-ca\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.949289 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.949265    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-secret-telemeter-client\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.949386 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.949366    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.949496 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.949478    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-telemeter-client-tls\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.950324 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.950305    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-federate-client-tls\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:25.959172 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:25.958530    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8h7s\" (UniqueName: \"kubernetes.io/projected/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-kube-api-access-z8h7s\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:26.117297 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.117094    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:26.263585 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.263506    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerStarted","Data":"abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd"}
Oct 30 20:39:26.263585 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.263585    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerStarted","Data":"f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc"}
Oct 30 20:39:26.263823 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.263626    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerStarted","Data":"ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a"}
Oct 30 20:39:26.263823 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.263669    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerStarted","Data":"fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7"}
Oct 30 20:39:26.263823 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.263705    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerStarted","Data":"84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b"}
Oct 30 20:39:26.265091 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.265063    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr" event={"ID":"18026b97-bf3c-49e4-8745-98869d8e1af2","Type":"ContainerStarted","Data":"5f63bad1d8f45285176f20bcf7a74703ad763d136a1209e98e80c1dff56aedf9"}
Oct 30 20:39:26.267232 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.267196    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59bcb84677-sjv66" event={"ID":"664f00cf-cee9-45ed-9af7-52c78892a6dd","Type":"ContainerStarted","Data":"7d0f9e3213022ec7022b9292b9f7ce51d35bf02ff1dbbf303b1236fc83eebab9"}
Oct 30 20:39:26.269751 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.269583    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx" event={"ID":"e77e6b22-b7c0-4053-a277-baf7073c6b54","Type":"ContainerStarted","Data":"e8841da300a2194a580d8741f2dffdc4edd6f8f8863c8e3ff9ed06e3a2cb8db6"}
Oct 30 20:39:26.269751 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.269647    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx" event={"ID":"e77e6b22-b7c0-4053-a277-baf7073c6b54","Type":"ContainerStarted","Data":"6ef6922602c503f87f00b34943fd699de323fa79131965da1c4223d5bcd7c522"}
Oct 30 20:39:26.269751 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.269686    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx" event={"ID":"e77e6b22-b7c0-4053-a277-baf7073c6b54","Type":"ContainerStarted","Data":"f2648fd441fc3e546e2ca971fb5eb3bd0bb2f9cab8b15d47f49474931bd0a0d3"}
Oct 30 20:39:26.419982 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.419903    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75d988bc69-vl9jp"]
Oct 30 20:39:26.424084 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:26.424052    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd74d48_bbb1_4d0b_bf06_ff393896e8c3.slice/crio-56bd4c4bcb76fec8354dc4462814428e2a79c1c0bd0458399b6e38502796003c WatchSource:0}: Error finding container 56bd4c4bcb76fec8354dc4462814428e2a79c1c0bd0458399b6e38502796003c: Status 404 returned error can't find the container with id 56bd4c4bcb76fec8354dc4462814428e2a79c1c0bd0458399b6e38502796003c
Oct 30 20:39:26.778649 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.778619    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 20:39:26.785518 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.785500    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.792591 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.792216    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 20:39:26.792591 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.792320    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 20:39:26.792591 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.792399    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 20:39:26.792591 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.792439    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-31m0mj31dkhmr\""
Oct 30 20:39:26.792591 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.792486    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 20:39:26.794981 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.794231    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 20:39:26.794981 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.794326    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rwtrp\""
Oct 30 20:39:26.794981 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.794414    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 20:39:26.794981 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.794494    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 20:39:26.794981 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.794558    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 20:39:26.794981 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.794625    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 20:39:26.794981 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.794707    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 20:39:26.794981 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.794874    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 20:39:26.800840 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.797596    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 20:39:26.804050 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.803997    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 20:39:26.806748 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.804681    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 20:39:26.807498 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.807472    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 20:39:26.853892 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.853856    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854102 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.853908    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854102 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.853940    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854102 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.853970    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854102 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.853998    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-config-out\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854102 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854046    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854107    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854128    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854146    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854166    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854180    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-config\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854209    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854227    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854242    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854267    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854283    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854301    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgkj8\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-kube-api-access-fgkj8\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854319    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-web-config\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854334    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.854376 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.854359    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.955891 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.955802    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.955891 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.955861    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.955891 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.955879    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-config\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.956145 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.955919    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.956145 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.955938    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.956145 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.955959    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.956145 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.955986    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.956145 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.956001    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.956145 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.956033    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgkj8\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-kube-api-access-fgkj8\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.956784    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.956849    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-web-config\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.956883    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.956933    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.956980    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.957013    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.957062    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.957095    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.957127    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-config-out\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.957152    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.957216    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.957248    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.957670 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.957270    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.958417 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.958067    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.959894 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.959828    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.961136 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.961110    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.961564 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.961545    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.961679 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.961654    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.963378 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.962685    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.963378 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.963338    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.963536 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.963406    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.964299 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.964258    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-config\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.964574 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.964557    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.964644 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.964615    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.964750 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.964734    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-config-out\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.965269 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.965247    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.965432 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.965411    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.965617 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.965598    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.966895 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.966875    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-web-config\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.967534 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.967476    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:26.969672 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:26.969140    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgkj8\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-kube-api-access-fgkj8\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:27.136762 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:27.134667    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:27.277955 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:27.277915    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx" event={"ID":"e77e6b22-b7c0-4053-a277-baf7073c6b54","Type":"ContainerStarted","Data":"fbc9b3842adcb1be63607ea0ed1b89bd18799b8c431dd2db68e354d087789447"}
Oct 30 20:39:27.278126 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:27.277982    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx" event={"ID":"e77e6b22-b7c0-4053-a277-baf7073c6b54","Type":"ContainerStarted","Data":"68830db5b74c72579e9838a118f23043096e60cf4b71a140d4db5de5a0d0db05"}
Oct 30 20:39:27.278126 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:27.278009    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx" event={"ID":"e77e6b22-b7c0-4053-a277-baf7073c6b54","Type":"ContainerStarted","Data":"41ad6de46630273385af3a3a2a438dcaba8d0a0504ac6da5425ce846caac4b6e"}
Oct 30 20:39:27.278775 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:27.278754    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:27.286122 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:27.286094    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerStarted","Data":"f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963"}
Oct 30 20:39:27.288274 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:27.288255    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp" event={"ID":"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3","Type":"ContainerStarted","Data":"56bd4c4bcb76fec8354dc4462814428e2a79c1c0bd0458399b6e38502796003c"}
Oct 30 20:39:27.306589 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:27.306544    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx" podStartSLOduration=2.252768784 podStartE2EDuration="5.30653214s" totalImagesPullingTime="3.053763356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:27.305628948 +0000 UTC m=+49.951824367" watchObservedRunningTime="2026-10-30 20:39:27.30653214 +0000 UTC m=+49.952727535"
Oct 30 20:39:27.472697 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:27.472643    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.74289519 podStartE2EDuration="6.472623877s" totalImagesPullingTime="3.723088354s" totalInitContainerRuntime="6.640333ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:27.342551132 +0000 UTC m=+49.988746546" watchObservedRunningTime="2026-10-30 20:39:27.472623877 +0000 UTC m=+50.118819273"
Oct 30 20:39:27.473803 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:27.473779    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 20:39:27.477354 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:27.477326    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92816bb4_0182_459b_984a_cfebd04c7f20.slice/crio-854824b400eb7368254f104ec9443ac24961b9e2661a14daf75142b623240d27 WatchSource:0}: Error finding container 854824b400eb7368254f104ec9443ac24961b9e2661a14daf75142b623240d27: Status 404 returned error can't find the container with id 854824b400eb7368254f104ec9443ac24961b9e2661a14daf75142b623240d27
Oct 30 20:39:28.296262 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:28.296229    2586 generic.go:356] "Generic (PLEG): container finished" podID="92816bb4-0182-459b-984a-cfebd04c7f20" containerID="b120b004a1507f1509bc531fa7f4ab70487dfbff0caefd6c3c334e2f1b82d69b" exitCode=0
Oct 30 20:39:28.296467 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:28.296322    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerDied","Data":"b120b004a1507f1509bc531fa7f4ab70487dfbff0caefd6c3c334e2f1b82d69b"}
Oct 30 20:39:28.296467 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:28.296442    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerStarted","Data":"854824b400eb7368254f104ec9443ac24961b9e2661a14daf75142b623240d27"}
Oct 30 20:39:28.297939 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:28.297914    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr" event={"ID":"18026b97-bf3c-49e4-8745-98869d8e1af2","Type":"ContainerStarted","Data":"ad7d2249bbeb0ca7adc6874667327f438f1a2ce0b988c5691d3b98549f5f56f3"}
Oct 30 20:39:28.298077 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:28.298054    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:28.299572 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:28.299549    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59bcb84677-sjv66" event={"ID":"664f00cf-cee9-45ed-9af7-52c78892a6dd","Type":"ContainerStarted","Data":"9ecf50b06e4649f28a22f56f314733ce2c662a2e2d3393c3cd2e87bbefdb479f"}
Oct 30 20:39:28.303691 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:28.303672    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:28.351221 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:28.351172    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr" podStartSLOduration=1.358865014 podStartE2EDuration="3.351156188s" totalImagesPullingTime="1.992291174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:28.349777885 +0000 UTC m=+50.995973313" watchObservedRunningTime="2026-10-30 20:39:28.351156188 +0000 UTC m=+50.997351582"
Oct 30 20:39:28.369727 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:28.369682    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-59bcb84677-sjv66" podStartSLOduration=2.307470484 podStartE2EDuration="4.369664094s" totalImagesPullingTime="2.06219361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:28.36870671 +0000 UTC m=+51.014902123" watchObservedRunningTime="2026-10-30 20:39:28.369664094 +0000 UTC m=+51.015859489"
Oct 30 20:39:29.306453 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:29.306402    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp" event={"ID":"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3","Type":"ContainerStarted","Data":"7af682059ad13a0e83a431b8900fe6c8876375020fc98a2ae0a58faedc400f21"}
Oct 30 20:39:29.306930 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:29.306474    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp" event={"ID":"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3","Type":"ContainerStarted","Data":"588ad110d0556e1ab1a82bbd5216959261b361e5605d46cfc803fb1ed52d84ff"}
Oct 30 20:39:29.307065 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:29.306502    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp" event={"ID":"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3","Type":"ContainerStarted","Data":"d21559cbf65cc44559217466b9db3cb8f30ff9f9449a70b7955843812dcc3b76"}
Oct 30 20:39:29.336106 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:29.336059    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp" podStartSLOduration=2.412336412 podStartE2EDuration="4.336045867s" totalImagesPullingTime="1.923709455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:29.335106399 +0000 UTC m=+51.981301805" watchObservedRunningTime="2026-10-30 20:39:29.336045867 +0000 UTC m=+51.982241262"
Oct 30 20:39:30.217717 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:30.217044    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:32.322351 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:32.322317    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerStarted","Data":"59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c"}
Oct 30 20:39:32.322770 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:32.322383    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerStarted","Data":"e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82"}
Oct 30 20:39:32.322770 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:32.322407    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerStarted","Data":"02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b"}
Oct 30 20:39:32.322770 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:32.322431    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerStarted","Data":"ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd"}
Oct 30 20:39:32.322770 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:32.322456    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerStarted","Data":"cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125"}
Oct 30 20:39:32.322770 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:32.322489    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerStarted","Data":"1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103"}
Oct 30 20:39:32.360510 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:32.360458    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.331665553 podStartE2EDuration="6.360441714s" totalImagesPullingTime="3.006185507s" totalInitContainerRuntime="22.590654ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:32.359743653 +0000 UTC m=+55.005939073" watchObservedRunningTime="2026-10-30 20:39:32.360441714 +0000 UTC m=+55.006637109"
Oct 30 20:39:34.313581 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:34.313556    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:36.068816 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:36.068788    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:37.135015 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:37.134969    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:43.519292 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.519252    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:43.522456 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.522439    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:39:43.531600 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.531574    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:43.552485 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.552464    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6zzqh\""
Oct 30 20:39:43.560564 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.560545    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:43.621296 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.620708    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:43.623949 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.623895    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:39:43.633553 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.633503    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:43.722219 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.722178    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8474p\" (UniqueName: \"kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p\") pod \"network-check-target-g5cnl\" (UID: \"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5\") " pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:43.725142 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.725125    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:39:43.735596 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.735570    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:39:43.746214 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.746194    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8474p\" (UniqueName: \"kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p\") pod \"network-check-target-g5cnl\" (UID: \"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5\") " pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:43.834917 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.834892    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d4pmp"]
Oct 30 20:39:43.837334 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:43.837309    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a3268c_635f_4eb2_a85d_f9c42a5d4db7.slice/crio-034a5af7714f8d96dfc353941c3e6e0cbb00efecedb39d49fed7a4be677a2484 WatchSource:0}: Error finding container 034a5af7714f8d96dfc353941c3e6e0cbb00efecedb39d49fed7a4be677a2484: Status 404 returned error can't find the container with id 034a5af7714f8d96dfc353941c3e6e0cbb00efecedb39d49fed7a4be677a2484
Oct 30 20:39:43.865271 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.865235    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-q55wr\""
Oct 30 20:39:43.873472 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.873447    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:43.885501 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.885481    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-r8zbf\""
Oct 30 20:39:43.893617 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:43.893593    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:44.147042 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:44.146919    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g5cnl"]
Oct 30 20:39:44.149454 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:44.149430    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3d2ec1_b5f3_499e_a5e2_b524d57837b5.slice/crio-5e4f8b268c9f6d8a5e2b5e60bd9542ada263daf851e3f5c91bd72b7b84146b6d WatchSource:0}: Error finding container 5e4f8b268c9f6d8a5e2b5e60bd9542ada263daf851e3f5c91bd72b7b84146b6d: Status 404 returned error can't find the container with id 5e4f8b268c9f6d8a5e2b5e60bd9542ada263daf851e3f5c91bd72b7b84146b6d
Oct 30 20:39:44.177785 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:44.177760    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8p5hf"]
Oct 30 20:39:44.180147 ip-10-0-131-162 kubenswrapper[2586]: W1030 20:39:44.180122    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28bc8e0_d670_4b43_bab5_d51bdbe1a350.slice/crio-a36998df039ab2626b86c69d421e07fabd68f0507aa7e8aa2d8e9cf116e42573 WatchSource:0}: Error finding container a36998df039ab2626b86c69d421e07fabd68f0507aa7e8aa2d8e9cf116e42573: Status 404 returned error can't find the container with id a36998df039ab2626b86c69d421e07fabd68f0507aa7e8aa2d8e9cf116e42573
Oct 30 20:39:44.367963 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:44.367927    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g5cnl" event={"ID":"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5","Type":"ContainerStarted","Data":"5e4f8b268c9f6d8a5e2b5e60bd9542ada263daf851e3f5c91bd72b7b84146b6d"}
Oct 30 20:39:44.369338 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:44.369286    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8p5hf" event={"ID":"c28bc8e0-d670-4b43-bab5-d51bdbe1a350","Type":"ContainerStarted","Data":"a36998df039ab2626b86c69d421e07fabd68f0507aa7e8aa2d8e9cf116e42573"}
Oct 30 20:39:44.370578 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:44.370557    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d4pmp" event={"ID":"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7","Type":"ContainerStarted","Data":"034a5af7714f8d96dfc353941c3e6e0cbb00efecedb39d49fed7a4be677a2484"}
Oct 30 20:39:45.034294 ip-10-0-131-162 kubenswrapper[2586]: E1030 20:39:45.034147    2586 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:39:45.322322 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:45.322284    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:45.322518 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:45.322386    2586 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:45.378598 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:45.378058    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d4pmp" event={"ID":"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7","Type":"ContainerStarted","Data":"06693e20385c6a12d154108d0fd2f673c3b737d702bba31dda43cfcb5d3cfaf3"}
Oct 30 20:39:45.378598 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:45.378123    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d4pmp" event={"ID":"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7","Type":"ContainerStarted","Data":"bdc8f63f7ab002ec37c7356e2992f65009822f34bfa85aedce2662f5b94897c5"}
Oct 30 20:39:45.398284 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:45.398226    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d4pmp" podStartSLOduration=66.472723222 podStartE2EDuration="1m7.398207859s" totalImagesPullingTime="925.484637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:45.396673503 +0000 UTC m=+68.042868899" watchObservedRunningTime="2026-10-30 20:39:45.398207859 +0000 UTC m=+68.044403257"
Oct 30 20:39:47.513984 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:47.512913    2586 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:47.533458 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:47.533425    2586 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:48.392740 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:48.392701    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g5cnl" event={"ID":"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5","Type":"ContainerStarted","Data":"baf509d96fbb66d78cba4619d4c8a006e244bfaed30689f1b704ebf415bc6d43"}
Oct 30 20:39:48.392911 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:48.392811    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:48.413378 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:48.413329    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g5cnl" podStartSLOduration=67.200055009 podStartE2EDuration="1m10.413310439s" totalImagesPullingTime="3.21325543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:39:48.411333617 +0000 UTC m=+71.057529017" watchObservedRunningTime="2026-10-30 20:39:48.413310439 +0000 UTC m=+71.059505836"
Oct 30 20:39:48.414972 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:48.414949    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:49.066013 ip-10-0-131-162 kubenswrapper[2586]: I1030 20:39:49.065926    2586 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:39:49.066067 ip-10-0-131-162 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 20:39:49.085397 ip-10-0-131-162 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 20:39:49.085565 ip-10-0-131-162 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 20:39:49.085743 ip-10-0-131-162 systemd[1]: kubelet.service: Consumed 4.702s CPU time.
Oct 30 20:39:49.103505 ip-10-0-131-162 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:39:49.169351 ip-10-0-131-162 kubenswrapper[6048]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:39:49.169351 ip-10-0-131-162 kubenswrapper[6048]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:39:49.169351 ip-10-0-131-162 kubenswrapper[6048]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:39:49.169351 ip-10-0-131-162 kubenswrapper[6048]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:39:49.171421 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171345    6048 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:39:49.171421 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171419    6048 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:39:49.171421 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171424    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171428    6048 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171431    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171433    6048 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171439    6048 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171442    6048 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171446    6048 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171448    6048 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171451    6048 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171453    6048 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171456    6048 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171458    6048 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171461    6048 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171463    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171466    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171468    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171471    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171473    6048 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171476    6048 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171478    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:39:49.171524 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171481    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171484    6048 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171486    6048 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171489    6048 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171492    6048 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171494    6048 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171497    6048 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171500    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171505    6048 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171509    6048 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171512    6048 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171515    6048 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171518    6048 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171521    6048 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171523    6048 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171526    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171529    6048 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171531    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171534    6048 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:39:49.172018 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171537    6048 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171539    6048 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171542    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171545    6048 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171547    6048 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171550    6048 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171552    6048 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171555    6048 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171558    6048 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171560    6048 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171563    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171565    6048 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171568    6048 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171571    6048 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171573    6048 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171576    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171579    6048 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171582    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171584    6048 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:39:49.172565 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171587    6048 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171589    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171592    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171594    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171597    6048 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171606    6048 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171609    6048 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171611    6048 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171614    6048 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171618    6048 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171620    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171623    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171625    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171628    6048 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171630    6048 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171633    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171636    6048 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171638    6048 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171641    6048 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171643    6048 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:39:49.173052 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171646    6048 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171648    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171651    6048 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171653    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171655    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171658    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171661    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171664    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171668    6048 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171674    6048 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171677    6048 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171680    6048 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171683    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171685    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171687    6048 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171690    6048 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171693    6048 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171695    6048 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171698    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:39:49.173544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171701    6048 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171703    6048 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171706    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171710    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171712    6048 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171715    6048 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.171717    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172565    6048 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172573    6048 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172577    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172582    6048 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172585    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172587    6048 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172590    6048 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172593    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172595    6048 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172598    6048 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172601    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172604    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172606    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:39:49.174032 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172609    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172611    6048 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172614    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172617    6048 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172619    6048 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172622    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172624    6048 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172627    6048 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172629    6048 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172632    6048 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172635    6048 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172637    6048 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172646    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172648    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172651    6048 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172654    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172657    6048 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172660    6048 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172662    6048 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:39:49.174546 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172665    6048 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172668    6048 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172671    6048 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172673    6048 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172676    6048 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172678    6048 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172681    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172684    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172686    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172689    6048 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172691    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172694    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172697    6048 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172699    6048 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172702    6048 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172705    6048 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172708    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172711    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172713    6048 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:39:49.175006 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172716    6048 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172718    6048 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172721    6048 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172724    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172727    6048 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172730    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172732    6048 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172740    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172743    6048 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172746    6048 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172748    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172751    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172754    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172762    6048 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172765    6048 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172767    6048 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172770    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172774    6048 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172779    6048 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:39:49.175517 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172781    6048 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172784    6048 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172787    6048 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172789    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172792    6048 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172795    6048 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172797    6048 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172799    6048 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172802    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172805    6048 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172808    6048 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172811    6048 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172813    6048 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172816    6048 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172820    6048 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172824    6048 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172827    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172830    6048 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172833    6048 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:39:49.175985 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172836    6048 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172839    6048 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172847    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172850    6048 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172852    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172855    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172858    6048 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172861    6048 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172863    6048 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172866    6048 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172868    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172871    6048 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172873    6048 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172876    6048 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172878    6048 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172881    6048 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.172883    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173397    6048 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173403    6048 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173406    6048 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:39:49.176487 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173408    6048 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173414    6048 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173417    6048 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173420    6048 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173422    6048 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173425    6048 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173428    6048 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173430    6048 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173435    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173437    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173441    6048 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173445    6048 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173448    6048 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173450    6048 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173453    6048 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173456    6048 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173459    6048 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173461    6048 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173464    6048 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:39:49.176989 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173466    6048 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173469    6048 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173471    6048 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173474    6048 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173477    6048 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173479    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173482    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173484    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173487    6048 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173489    6048 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173493    6048 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173497    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173500    6048 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173503    6048 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173507    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173509    6048 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173512    6048 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173515    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173517    6048 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:39:49.177458 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173520    6048 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173523    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173527    6048 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173530    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173547    6048 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173552    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173555    6048 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173559    6048 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173562    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173567    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173571    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173573    6048 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173576    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173579    6048 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173581    6048 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173584    6048 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173587    6048 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173589    6048 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173592    6048 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:39:49.177954 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173594    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173597    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173599    6048 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173602    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173604    6048 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173607    6048 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173609    6048 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173612    6048 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173615    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173618    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173620    6048 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173623    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173625    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173628    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173630    6048 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173634    6048 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173637    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173639    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173642    6048 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:39:49.178598 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173644    6048 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173647    6048 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173649    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173652    6048 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173655    6048 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173658    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173660    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173663    6048 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173666    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173668    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173671    6048 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173673    6048 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173676    6048 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173679    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173682    6048 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173685    6048 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173687    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173690    6048 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173692    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:39:49.179432 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173695    6048 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173697    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173700    6048 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173703    6048 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173705    6048 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173708    6048 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173710    6048 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.173713    6048 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173803    6048 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173815    6048 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173833    6048 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173841    6048 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173846    6048 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173849    6048 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173854    6048 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173858    6048 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173861    6048 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173864    6048 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173874    6048 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173878    6048 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173881    6048 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173884    6048 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173887    6048 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:39:49.179944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173890    6048 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173893    6048 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173896    6048 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173902    6048 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173905    6048 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173908    6048 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173912    6048 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173915    6048 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173919    6048 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173922    6048 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173925    6048 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173928    6048 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173931    6048 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173934    6048 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173937    6048 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173940    6048 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173943    6048 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173948    6048 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173952    6048 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173955    6048 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173958    6048 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173961    6048 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173964    6048 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173971    6048 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173974    6048 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:39:49.180657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173977    6048 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173980    6048 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173983    6048 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173993    6048 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173996    6048 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.173999    6048 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174002    6048 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174005    6048 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174008    6048 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174011    6048 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174014    6048 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174017    6048 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174032    6048 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174035    6048 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174039    6048 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174043    6048 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174046    6048 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174049    6048 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174052    6048 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174055    6048 flags.go:64] FLAG: --help="false"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174058    6048 flags.go:64] FLAG: --hostname-override="ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174062    6048 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174065    6048 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:39:49.181334 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174068    6048 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174071    6048 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174075    6048 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174078    6048 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174081    6048 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174084    6048 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174086    6048 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174089    6048 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174092    6048 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174095    6048 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174098    6048 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174101    6048 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174104    6048 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174114    6048 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174117    6048 flags.go:64] FLAG: --lock-file=""
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174120    6048 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174124    6048 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174127    6048 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174133    6048 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174136    6048 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174138    6048 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174141    6048 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174144    6048 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174148    6048 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:39:49.181904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174151    6048 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174153    6048 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174158    6048 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174161    6048 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174165    6048 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174168    6048 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174171    6048 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174174    6048 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174176    6048 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174180    6048 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174183    6048 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174186    6048 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174192    6048 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174195    6048 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174198    6048 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174201    6048 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174204    6048 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174207    6048 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174210    6048 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174213    6048 flags.go:64] FLAG: --port="10250"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174216    6048 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174219    6048 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-09b15f447c87517aa"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174228    6048 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174231    6048 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174235    6048 flags.go:64] FLAG: --register-node="true"
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174238    6048 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:39:49.182509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174242    6048 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174245    6048 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174248    6048 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174251    6048 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174255    6048 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174258    6048 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174261    6048 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174264    6048 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174267    6048 flags.go:64] FLAG: --runonce="false"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174270    6048 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174273    6048 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174276    6048 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174279    6048 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174282    6048 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174285    6048 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174288    6048 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174291    6048 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174294    6048 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174297    6048 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174300    6048 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174303    6048 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174306    6048 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174315    6048 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174318    6048 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174323    6048 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:39:49.183177 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174326    6048 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174329    6048 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174335    6048 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174338    6048 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174346    6048 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174350    6048 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174353    6048 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174357    6048 flags.go:64] FLAG: --v="2"
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174362    6048 flags.go:64] FLAG: --version="false"
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174366    6048 flags.go:64] FLAG: --vmodule=""
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174370    6048 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174373    6048 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174559    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174564    6048 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174567    6048 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174570    6048 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174573    6048 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174576    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174579    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174581    6048 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174584    6048 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174587    6048 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:39:49.183852 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174589    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174592    6048 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174595    6048 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174597    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174600    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174603    6048 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174605    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174608    6048 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174611    6048 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174613    6048 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174616    6048 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174619    6048 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174622    6048 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174627    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174630    6048 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174641    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174644    6048 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174648    6048 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174650    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:39:49.184413 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174653    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174656    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174658    6048 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174661    6048 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174664    6048 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174666    6048 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174669    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174671    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174674    6048 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174676    6048 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174679    6048 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174681    6048 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174684    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174687    6048 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174689    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174692    6048 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174694    6048 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174697    6048 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174699    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174702    6048 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:39:49.185111 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174705    6048 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174707    6048 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174710    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174713    6048 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174715    6048 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174718    6048 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174720    6048 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174723    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174728    6048 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174737    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174741    6048 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174744    6048 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174747    6048 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174749    6048 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174752    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174754    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174757    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174760    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174762    6048 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174765    6048 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:39:49.185711 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174767    6048 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174770    6048 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174773    6048 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174776    6048 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174778    6048 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174781    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174784    6048 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174788    6048 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174792    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174794    6048 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174797    6048 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174800    6048 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174803    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174805    6048 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174808    6048 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174810    6048 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174813    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174815    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174818    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174820    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:39:49.186286 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174824    6048 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174827    6048 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174836    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174840    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174843    6048 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174845    6048 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174848    6048 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174850    6048 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174853    6048 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174856    6048 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174858    6048 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174861    6048 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174863    6048 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174866    6048 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174869    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174871    6048 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:39:49.187235 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174874    6048 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.174899    6048 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174946    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174950    6048 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174953    6048 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174955    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174958    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174961    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174963    6048 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174966    6048 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174968    6048 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174971    6048 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174973    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174976    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174978    6048 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174981    6048 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:39:49.187979 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174985    6048 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174987    6048 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.174990    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175000    6048 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175003    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175006    6048 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175008    6048 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175011    6048 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175014    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175017    6048 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175033    6048 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175036    6048 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175039    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175042    6048 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175050    6048 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175053    6048 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175056    6048 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175058    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175061    6048 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:39:49.188512 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175064    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175066    6048 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175069    6048 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175071    6048 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175074    6048 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175076    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175079    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175081    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175084    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175087    6048 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175089    6048 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175092    6048 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175094    6048 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175098    6048 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175101    6048 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175104    6048 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175108    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175122    6048 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175126    6048 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:39:49.189169 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175130    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175133    6048 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175136    6048 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175138    6048 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175141    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175143    6048 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175146    6048 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175149    6048 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175151    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175154    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175157    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175159    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175162    6048 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175165    6048 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175167    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175170    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175173    6048 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175175    6048 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175178    6048 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175180    6048 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:39:49.189715 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175183    6048 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175193    6048 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175196    6048 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175199    6048 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175201    6048 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175204    6048 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175208    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175210    6048 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175213    6048 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175217    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175219    6048 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175227    6048 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175230    6048 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175233    6048 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175236    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175238    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175241    6048 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175243    6048 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175246    6048 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175248    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:39:49.190231 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175251    6048 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175254    6048 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175256    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175259    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175261    6048 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175264    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175267    6048 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175269    6048 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175272    6048 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175275    6048 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175277    6048 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175281    6048 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175284    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.175287    6048 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.180445    6048 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.180461    6048 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.180479    6048 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.180484    6048 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180538    6048 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:39:49.190751 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180543    6048 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180546    6048 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180549    6048 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180552    6048 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180555    6048 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180558    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180560    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180563    6048 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180566    6048 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180569    6048 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180572    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180575    6048 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180578    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180581    6048 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180584    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180586    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180589    6048 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180592    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180595    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:39:49.191248 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180598    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180600    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180603    6048 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180606    6048 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180609    6048 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180611    6048 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180615    6048 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180619    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180623    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180627    6048 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180630    6048 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180634    6048 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180636    6048 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180639    6048 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180642    6048 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180644    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180647    6048 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180650    6048 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:39:49.191700 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180652    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180655    6048 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180657    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180660    6048 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180663    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180666    6048 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180668    6048 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180671    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180674    6048 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180678    6048 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180680    6048 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180683    6048 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180686    6048 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180689    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180691    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180694    6048 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180696    6048 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180699    6048 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180702    6048 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180704    6048 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:39:49.192159 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180707    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180709    6048 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180712    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180716    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180718    6048 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180721    6048 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180723    6048 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180726    6048 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180728    6048 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180731    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180733    6048 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180736    6048 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180739    6048 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180741    6048 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180744    6048 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180747    6048 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180749    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180752    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180755    6048 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180757    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:39:49.192640 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180760    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180770    6048 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180773    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180776    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180778    6048 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180781    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180783    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180786    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180789    6048 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180791    6048 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180794    6048 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180796    6048 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180799    6048 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180802    6048 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180804    6048 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180807    6048 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180810    6048 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180812    6048 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180816    6048 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180820    6048 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:39:49.193129 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180823    6048 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180825    6048 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180828    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180830    6048 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180833    6048 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180836    6048 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180838    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.180841    6048 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.180868    6048 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181004    6048 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181013    6048 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181037    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181043    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181047    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181057    6048 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:39:49.193618 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181060    6048 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181063    6048 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181065    6048 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181068    6048 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181071    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181073    6048 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181076    6048 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181079    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181081    6048 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181084    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181086    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181090    6048 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181093    6048 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181095    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181098    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181100    6048 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181103    6048 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181106    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181108    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:39:49.193981 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181111    6048 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181113    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181116    6048 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181118    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181121    6048 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181124    6048 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181126    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181129    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181131    6048 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181134    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181136    6048 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181139    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181141    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181146    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181148    6048 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181151    6048 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181154    6048 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181156    6048 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181159    6048 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:39:49.194544 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181162    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181164    6048 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181167    6048 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181169    6048 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181172    6048 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181175    6048 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181177    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181180    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181182    6048 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181185    6048 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181188    6048 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181190    6048 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181193    6048 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181195    6048 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181198    6048 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181200    6048 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181203    6048 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181205    6048 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181208    6048 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181210    6048 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:39:49.195104 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181213    6048 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181215    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181218    6048 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181220    6048 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181223    6048 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181225    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181228    6048 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181231    6048 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181234    6048 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181236    6048 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181239    6048 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181241    6048 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181244    6048 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181246    6048 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181249    6048 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181251    6048 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181254    6048 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181257    6048 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181259    6048 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181262    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:39:49.195611 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181264    6048 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181268    6048 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181273    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181276    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181279    6048 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181281    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181284    6048 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181286    6048 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181289    6048 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181292    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181294    6048 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181297    6048 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181299    6048 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181302    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181304    6048 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181307    6048 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181309    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181312    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181314    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:39:49.196131 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181317    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181320    6048 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181323    6048 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.181347    6048 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181379    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181383    6048 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181386    6048 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181389    6048 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181392    6048 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181395    6048 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181398    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181401    6048 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181403    6048 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181406    6048 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181408    6048 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181411    6048 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:39:49.196628 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181414    6048 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181416    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181419    6048 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181422    6048 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181424    6048 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181427    6048 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181429    6048 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181432    6048 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181434    6048 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181437    6048 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181440    6048 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181442    6048 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181445    6048 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181447    6048 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181450    6048 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181453    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181456    6048 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181458    6048 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181461    6048 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181464    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:39:49.197017 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181466    6048 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181469    6048 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181471    6048 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181474    6048 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181476    6048 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181479    6048 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181482    6048 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181484    6048 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181487    6048 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181489    6048 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181492    6048 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181495    6048 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181497    6048 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181500    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181502    6048 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181506    6048 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181510    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181513    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181516    6048 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181519    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:39:49.197590 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181521    6048 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181524    6048 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181526    6048 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181529    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181531    6048 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181534    6048 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181536    6048 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181539    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181544    6048 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181547    6048 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181549    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181552    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181555    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181558    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181560    6048 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181563    6048 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181566    6048 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181572    6048 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181576    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:39:49.198155 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181579    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181582    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181585    6048 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181587    6048 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181590    6048 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181592    6048 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181595    6048 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181598    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181600    6048 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181603    6048 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181606    6048 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181608    6048 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181611    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181613    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181616    6048 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181619    6048 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181621    6048 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181624    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181626    6048 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:39:49.198762 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181629    6048 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181632    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181635    6048 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181638    6048 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181641    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181643    6048 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181646    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181649    6048 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181652    6048 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181656    6048 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181659    6048 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181663    6048 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181665    6048 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181668    6048 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181671    6048 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:39:49.181673    6048 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.181723    6048 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.182671    6048 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.182735    6048 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 20:39:49.199586 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.182921    6048 server.go:1014] "Starting client certificate rotation"
Oct 30 20:39:49.200268 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.183050    6048 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:39:49.200268 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.183108    6048 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:33:37 +0000 UTC" deadline="2028-08-13 16:08:38.262013952 +0000 UTC"
Oct 30 20:39:49.200268 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.183144    6048 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15667h28m49.078872858s"
Oct 30 20:39:49.200268 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.183458    6048 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:39:49.200268 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.184520    6048 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:39:49.200268 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.185856    6048 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:39:49.200268 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.188392    6048 log.go:25] "Validated CRI v1 image API"
Oct 30 20:39:49.200268 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.189145    6048 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:39:49.200268 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.191516    6048 fs.go:135] Filesystem UUIDs: map[37c8d8e7-da8f-4123-b2d7-dfb34057bff4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 870a77ff-aec5-482d-8ccd-2d21511610eb:/dev/nvme0n1p3]
Oct 30 20:39:49.200678 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.191537    6048 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/034a5af7714f8d96dfc353941c3e6e0cbb00efecedb39d49fed7a4be677a2484/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/034a5af7714f8d96dfc353941c3e6e0cbb00efecedb39d49fed7a4be677a2484/userdata/shm major:0 minor:517 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/189329a83c01a187b71d6763260eeceb5bafb600d957eb1c87299431e7b8dace/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/189329a83c01a187b71d6763260eeceb5bafb600d957eb1c87299431e7b8dace/userdata/shm major:0 minor:203 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1fdee27a5c298bf17ce3b450222bfcba30f451da581529672c8ba096b76f433f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1fdee27a5c298bf17ce3b450222bfcba30f451da581529672c8ba096b76f433f/userdata/shm major:0 minor:49 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2f80595f08b8ae4d2913fe97ee2f206a1876f8f5453360ee98078063c4f66014/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2f80595f08b8ae4d2913fe97ee2f206a1876f8f5453360ee98078063c4f66014/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/302193ecf56ef78205adbdf4ce9f0eb6324dd7462565394da72a2404ce9a1ea9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/302193ecf56ef78205adbdf4ce9f0eb6324dd7462565394da72a2404ce9a1ea9/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/49fec735c0078506dcadfb5469460fa04e272165bdb1b449697d8a8e2595f925/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/49fec735c0078506dcadfb5469460fa04e272165bdb1b449697d8a8e2595f925/userdata/shm major:0 minor:279 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4f9b88ab371bdb0b06b12e2e8fffc8113c24f1f0fa9edbd0a65ed6657ec025d1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4f9b88ab371bdb0b06b12e2e8fffc8113c24f1f0fa9edbd0a65ed6657ec025d1/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5638334c773411572ebc8b8f1b9175ba85ae8448c51b8704b7d40db55b4ecffa/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5638334c773411572ebc8b8f1b9175ba85ae8448c51b8704b7d40db55b4ecffa/userdata/shm major:0 minor:220 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/56bd4c4bcb76fec8354dc4462814428e2a79c1c0bd0458399b6e38502796003c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/56bd4c4bcb76fec8354dc4462814428e2a79c1c0bd0458399b6e38502796003c/userdata/shm major:0 minor:414 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5e4f8b268c9f6d8a5e2b5e60bd9542ada263daf851e3f5c91bd72b7b84146b6d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5e4f8b268c9f6d8a5e2b5e60bd9542ada263daf851e3f5c91bd72b7b84146b6d/userdata/shm major:0 minor:523 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5f63bad1d8f45285176f20bcf7a74703ad763d136a1209e98e80c1dff56aedf9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5f63bad1d8f45285176f20bcf7a74703ad763d136a1209e98e80c1dff56aedf9/userdata/shm major:0 minor:372 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/75d9beb7d1bcd1538d136a4338682fdf81d5288863335220f95e353300476cc9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/75d9beb7d1bcd1538d136a4338682fdf81d5288863335220f95e353300476cc9/userdata/shm major:0 minor:283 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/783f50999e1d0aa329095c4dd094ec456f66bb8c17988ca603eeae80f7aedecf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/783f50999e1d0aa329095c4dd094ec456f66bb8c17988ca603eeae80f7aedecf/userdata/shm major:0 minor:310 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7d0f9e3213022ec7022b9292b9f7ce51d35bf02ff1dbbf303b1236fc83eebab9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7d0f9e3213022ec7022b9292b9f7ce51d35bf02ff1dbbf303b1236fc83eebab9/userdata/shm major:0 minor:360 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7fe042e648a2d438bfccf23709449378b3b9acb75f58e71ea91eeaa47c55313b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7fe042e648a2d438bfccf23709449378b3b9acb75f58e71ea91eeaa47c55313b/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/854824b400eb7368254f104ec9443ac24961b9e2661a14daf75142b623240d27/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/854824b400eb7368254f104ec9443ac24961b9e2661a14daf75142b623240d27/userdata/shm major:0 minor:453 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8c1d56b3727d63b653a5bdf6d6eff2d188146adaf217cbbc16d82acd6e4c4ff7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8c1d56b3727d63b653a5bdf6d6eff2d188146adaf217cbbc16d82acd6e4c4ff7/userdata/shm major:0 minor:97 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8d8228f788316bce4e6637a28679a7abacfc962f7671cfacabeb6bbb7740ef5b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8d8228f788316bce4e6637a28679a7abacfc962f7671cfacabeb6bbb7740ef5b/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/96e953c5ee9433035f75b131726e33539afad27b08b4802560262dde3af9ea68/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/96e953c5ee9433035f75b131726e33539afad27b08b4802560262dde3af9ea68/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9e994b987cf79e6aef1f63fda9266ad24179b5f16f626a1f2b2819e48e9668ff/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9e994b987cf79e6aef1f63fda9266ad24179b5f16f626a1f2b2819e48e9668ff/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9fc4adb92295d4e6016e7340547e48bb93dcea8c49a70a47e932b7d15dce8468/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9fc4adb92295d4e6016e7340547e48bb93dcea8c49a70a47e932b7d15dce8468/userdata/shm major:0 minor:277 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a36998df039ab2626b86c69d421e07fabd68f0507aa7e8aa2d8e9cf116e42573/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a36998df039ab2626b86c69d421e07fabd68f0507aa7e8aa2d8e9cf116e42573/userdata/shm major:0 minor:525 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ba3c1bbd08e26604ed7728f99e16ccad1abb1378d83d851805e57f2e8d372276/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ba3c1bbd08e26604ed7728f99e16ccad1abb1378d83d851805e57f2e8d372276/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d7cf877aa3e82e6f4e9180c58c4e48247012fd932f39f063b09d902f9007a03d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d7cf877aa3e82e6f4e9180c58c4e48247012fd932f39f063b09d902f9007a03d/userdata/shm major:0 minor:323 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/db92f8226a7e88de443efa78a8be1e82e50101613499bfb5699744a195ecfae7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/db92f8226a7e88de443efa78a8be1e82e50101613499bfb5699744a195ecfae7/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dd7ad502ab0f589a77b9964bbf0f0b218ba7cf827da748a4434d078164a3e9c4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dd7ad502ab0f589a77b9964bbf0f0b218ba7cf827da748a4434d078164a3e9c4/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/01fae3a3-8169-40f8-b7b8-d313c96b6add/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/01fae3a3-8169-40f8-b7b8-d313c96b6add/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/01fae3a3-8169-40f8-b7b8-d313c96b6add/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/01fae3a3-8169-40f8-b7b8-d313c96b6add/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/01fae3a3-8169-40f8-b7b8-d313c96b6add/volumes/kubernetes.io~projected/kube-api-access-5ltvz:{mountpoint:/var/lib/kubelet/pods/01fae3a3-8169-40f8-b7b8-d313c96b6add/volumes/kubernetes.io~projected/kube-api-access-5ltvz major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06b08ffe-ca3b-4535-8563-567227a4af3e/volumes/kubernetes.io~projected/kube-api-access-lslgj:{mountpoint:/var/lib/kubelet/pods/06b08ffe-ca3b-4535-8563-567227a4af3e/volumes/kubernetes.io~projected/kube-api-access-lslgj major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06b08ffe-ca3b-4535-8563-567227a4af3e/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/06b08ffe-ca3b-4535-8563-567227a4af3e/volumes/kubernetes.io~secret/cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1/volumes/kubernetes.io~projected/kube-api-access-h64qc:{mountpoint:/var/lib/kubelet/pods/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1/volumes/kubernetes.io~projected/kube-api-access-h64qc major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ef23080-50af-4c4e-9cba-64a5c85fc4ac/volumes/kubernetes.io~projected/kube-api-access-bnqtl:{mountpoint:/var/lib/kubelet/pods/0ef23080-50af-4c4e-9cba-64a5c85fc4ac/volumes/kubernetes.io~projected/kube-api-access-bnqtl major:0 minor:275 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ef23080-50af-4c4e-9cba-64a5c85fc4ac/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/0ef23080-50af-4c4e-9cba-64a5c85fc4ac/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0ef23080-50af-4c4e-9cba-64a5c85fc4ac/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/0ef23080-50af-4c4e-9cba-64a5c85fc4ac/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:272 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18026b97-bf3c-49e4-8745-98869d8e1af2/volumes/kubernetes.io~projected/kube-api-access-c44dq:{mountpoint:/var/lib/kubelet/pods/18026b97-bf3c-49e4-8745-98869d8e1af2/volumes/kubernetes.io~projected/kube-api-access-c44dq major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18026b97-bf3c-49e4-8745-98869d8e1af2/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/18026b97-bf3c-49e4-8745-98869d8e1af2/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:362 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5/volumes/kubernetes.io~projected/kube-api-access-8474p:{mountpoint:/var/lib/kubelet/pods/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5/volumes/kubernetes.io~projected/kube-api-access-8474p major:0 minor:520 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/241b828d-8324-467d-9f6b-ab0c3959b895/volumes/kubernetes.io~projected/kube-api-access-99zv4:{mountpoint:/var/lib/kubelet/pods/241b828d-8324-467d-9f6b-ab0c3959b895/volumes/kubernetes.io~projected/kube-api-access-99zv4 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/241b828d-8324-467d-9f6b-ab0c3959b895/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/241b828d-8324-467d-9f6b-ab0c3959b895/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/33b22c6f-4f13-4e54-9304-cfa57f52fbe1/volumes/kubernetes.io~projected/kube-api-access-976qn:{mountpoint:/var/lib/kubelet/pods/33b22c6f-4f13-4e54-9304-cfa57f52fbe1/volumes/kubernetes.io~projected/kube-api-access-976qn major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/664f00cf-cee9-45ed-9af7-52c78892a6dd/volumes/kubernetes.io~projected/kube-api-access-lmzqj:{mountpoint:/var/lib/kubelet/pods/664f00cf-cee9-45ed-9af7-52c78892a6dd/volumes/kubernetes.io~projected/kube-api-access-lmzqj major:0 minor:359 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/664f00cf-cee9-45ed-9af7-52c78892a6dd/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/664f00cf-cee9-45ed-9af7-52c78892a6dd/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:351 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/664f00cf-cee9-45ed-9af7-52c78892a6dd/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/664f00cf-cee9-45ed-9af7-52c78892a6dd/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:350 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/664f00cf-cee9-45ed-9af7-52c78892a6dd/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/664f00cf-cee9-45ed-9af7-52c78892a6dd/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/840bcd20-c702-4818-8e4e-0caa0ae2ffe3/volumes/kubernetes.io~projected/kube-api-access-fn92l:{mountpoint:/var/lib/kubelet/pods/840bcd20-c702-4818-8e4e-0caa0ae2ffe3/volumes/kubernetes.io~projected/kube-api-access-fn92l major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volume-subpaths/web-config/config-reloader/2 major:0 minor:450 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:450 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volume-subpaths/web-config/prometheus/15 major:0 minor:450 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~empty-dir/config-out major:0 minor:444 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~projected/kube-api-access-fgkj8:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~projected/kube-api-access-fgkj8 major:0 minor:452 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~projected/tls-assets major:0 minor:442 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/config major:0 minor:443 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:448 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:438 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:445 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:449 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:447 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:451 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:446 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/web-config major:0 minor:450 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c/volumes/kubernetes.io~projected/kube-api-access-b5wl6:{mountpoint:/var/lib/kubelet/pods/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c/volumes/kubernetes.io~projected/kube-api-access-b5wl6 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~projected/kube-api-access-z8h7s:{mountpoint:/var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~projected/kube-api-access-z8h7s major:0 minor:398 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:397 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:394 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:395 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:396 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a3510fa5-8b88-4b4d-893a-f3dca0163e72/volumes/kubernetes.io~projected/kube-api-access-x6c2k:{mountpoint:/var/lib/kubelet/pods/a3510fa5-8b88-4b4d-893a-f3dca0163e72/volumes/kubernetes.io~projected/kube-api-access-x6c2k major:0 minor:274 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a3510fa5-8b88-4b4d-893a-f3dca0163e72/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/a3510fa5-8b88-4b4d-893a-f3dca0163e72/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:273 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a3510fa5-8b88-4b4d-893a-f3dca0163e72/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/a3510fa5-8b88-4b4d-893a-f3dca0163e72/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:261 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volume-subpaths/web-config/alertmanager/9 major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volume-subpaths/web-config/config-reloader/6 major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~empty-dir/config-out major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~projected/kube-api-access-wk5nj:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~projected/kube-api-access-wk5nj major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~projected/tls-assets major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/config-volume major:0 minor:306 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:305 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:307 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:308 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/web-config major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7/volumes/kubernetes.io~projected/kube-api-access-95s77:{mountpoint:/var/lib/kubelet/pods/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7/volumes/kubernetes.io~projected/kube-api-access-95s77 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7/volumes/kubernetes.io~secret/metrics-certs major:0 minor:513 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c28bc8e0-d670-4b43-bab5-d51bdbe1a350/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/c28bc8e0-d670-4b43-bab5-d51bdbe1a350/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:519 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c5071a82-ea2d-426c-83da-9eae94007232/volumes/kubernetes.io~projected/kube-api-access-jkgw8:{mountpoint:/var/lib/kubelet/pods/c5071a82-ea2d-426c-83da-9eae94007232/volumes/kubernetes.io~projected/kube-api-access-jkgw8 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d/volumes/kubernetes.io~projected/kube-api-access-69v72:{mountpoint:/var/lib/kubelet/pods/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d/volumes/kubernetes.io~projected/kube-api-access-69v72 major:0 minor:276 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:271 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:262 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6ef821a-391c-4775-9cf4-f54b1a4d247d/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/c6ef821a-391c-4775-9cf4-f54b1a4d247d/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d26003df-46f0-4d7b-bd2c-b7fe898533cd/volumes/kubernetes.io~projected/kube-api-access-dcvn9:{mountpoint:/var/lib/kubelet/pods/d26003df-46f0-4d7b-bd2c-b7fe898533cd/volumes/kubernetes.io~projected/kube-api-access-dcvn9 major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d26003df-46f0-4d7b-bd2c-b7fe898533cd/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/d26003df-46f0-4d7b-bd2c-b7fe898533cd/volumes/kubernetes.io~secret/metrics-tls major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~projected/kube-api-access-ckzzb:{mountpoint:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~projected/kube-api-access-ckzzb major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f01d076a-94ad-4eb5-8886-0771d5a50440/volumes/kubernetes.io~projected/kube-api-access-wlhs8:{mountpoint:/var/lib/kubelet/pods/f01d076a-94ad-4eb5-8886-0771d5a50440/volumes/kubernetes.io~projected/kube-api-access-wlhs8 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74/volumes/kubernetes.io~projected/kube-api-access-dl7sk:{mountpoint:/var/lib/kubelet/pods/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74/volumes/kubernetes.io~projected/kube-api-access-dl7sk major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fbd28ece-83af-4175-a32f-774fe77aae9f/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/fbd28ece-83af-4175-a32f-774fe77aae9f/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fbd28ece-83af-4175-a32f-774fe77aae9f/volumes/kubernetes.io~projected/kube-api-access-98cqt:{mountpoint:/var/lib/kubelet/pods/fbd28ece-83af-4175-a32f-774fe77aae9f/volumes/kubernetes.io~projected/kube-api-access-98cqt major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fbd28ece-83af-4175-a32f-774fe77aae9f/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/fbd28ece-83af-4175-a32f-774fe77aae9f/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/e7c92790dea990d144f8ccd72e455237b427b2f5b7a981f6488572c66aa3443a/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/0620597e4e34ebe49ed543dbf795abc80543f411de3164d79116cac57eb5f8d3/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/47a4db37892e16e91e2aacb5cc87f93932ce49688e9b537a10ee743a1da7deb4/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/2e1ec72454839f4dc21a9523385b97e8d6c06b88bbc3e58ee73465400e482f3c/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/30f37ee06897ed07d265fa650f0a8fd5141fcab96f2ee3efa0b2d2f47a94c896/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/96a8f38ad8f7993ec9f8cefc72da122c41b5ff8217760d3a4599f93fc068df58/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/3a58a59a6f351480d9bfaa0d11b374126b8b047ecba813f2ef0b44f34e2027ce/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/ed41b0288d80fc27883468af661172a1fbb91f6ab44ed007824e2c1139dc0de7/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/e3a6ac4de03e733f8e4388738bea89d49969e0be3d3ae29f8ec0e6e085cedf86/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/fbfde1fab3ca59d0a742ad7cb046e2438db1eb59ea195b27f323a66579db158d/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/a498bde554ab312957d6e3930f14e4c4a7048e3d1f47e4588854ff292abaffe4/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/c5c8b512be825f0e05204b88638a992bf93c46db57d14f40cc4a98d842d1e02c/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/74dd549b4bcf53783103f00d92b3eae9531ffd4071f817d9258b2296456e5eda/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/e444251bde771ab3b27f8db25d989d6f6e6ed39b9b2963d7ea62d53fa3066f14/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/57b34e297d0940e859d088b4fbf5581f633c1ee0a4beddd568b30a0e1b1213cc/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/105690f3b29abac793a381abb0a149dfe988e1a39915b0a92e87c1d0e3033b03/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/da92b052a59c552f5609298da59d26c889b700bd8268753389388f6b6d0d4dd1/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/15845079b554999786cb35462ec4cb4f0e8c739edba8cea8adf342b7dfa817b9/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/0b7317367ad8373d9fc03838f4d84efd8bcccb85876c29d8ef080813313c35e7/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/dd5f65a82bd1ff3832a55f3c40ff926712cf868cf53506786051c8c95abd9055/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/100bf5a3678e1b47bd71a92cdbaf2bf8d144bb3bb5fdde616d77aa281a7f35fb/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-214:{mountpoint:/var/lib/containers/storage/overlay/7a56b9146e5a08d1bb9007a63d7513528dabbd76f33a0b655b359e6528c570f9/merged major:0 minor:214 fsType:overlay blockSize:0} overlay_0-216:{mountpoint:/var/lib/containers/storage/overlay/e042d0958924e25bddd78d86bdce63f63815d635eb97ce9bc88ce73fc094a8cf/merged major:0 minor:216 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/a2c329ff5430735f1a7f0be578eb7c69ef29b0005b43e8cc4944dda61c81e101/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/e11d19d5c0c3b4d58eedaa5e497af87c7f76dca7af52a347f68e82256306ea0c/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-224:{mountpoint:/var/lib/containers/storage/overlay/f2655f72b6df3c89641e8fb0fadd2360a7955aac83688241d863acd478cb02be/merged major:0 minor:224 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/43d4da2875c213cea5480fc1cf3ae6f27927be7f8e3feabb3cb289794e73c5b6/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-232:{mountpoint:/var/lib/containers/storage/overlay/264ccd452fb8ba9c800a73fd291c96160d253521d82fd67c2b2eb20aaf8c64f5/merged major:0 minor:232 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/769dc391f206e10ae167a6646494fe3e69d6237020730ecfca6ecca8c68dca1d/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-243:{mountpoint:/var/lib/containers/storage/overlay/93fb45a0f3a51e5144747884efca08d3f55e846e6941513328235d3be318abf7/merged major:0 minor:243 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/074ab59af9e984491be8e3ef0f54d9756e534242a4c42394263d130f677c7fd7/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/118d2b8cb73c5fc407c7919c41ff4e7cbba23d8f01a618652c5db04af2dbd1c8/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/ecc4af383aa25d91159b8c28aac3b7c06b0ffb1ae5166c42bb5dac555d59b005/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/971f02e33adece1df83c1f01801f0ab17e5b22edf3d744280d9e11c803b54407/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-285:{mountpoint:/var/lib/containers/storage/overlay/efcb182df8d63012f70cd3010cafbea8c8390d50ea471b3b1ac29ccd351df1cf/merged major:0 minor:285 fsType:overlay blockSize:0} overlay_0-287:{mountpoint:/var/lib/containers/storage/overlay/36bebf750171157aa649f0c1952a57bf288cff2b2bb9306e865200fbfa0fcb34/merged major:0 minor:287 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/74518a65663888de792735c134bfc4e75c1470f4894f35b0189153428d047aba/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/26a8ac73283d6747b71733efa13ba62a724f1282618f4f288606a5aa4a3cb3ab/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/b5dc0d29f69da720ab331ff8cb33e032780b9f7c68b75f345ac08fbef3e4fbd7/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-321:{mountpoint:/var/lib/containers/storage/overlay/ca3d9fc609c3ed2978b035987f8f6a6476293fbdd1adf77541a5ad36922b94b0/merged major:0 minor:321 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/fa181ddd85c8034a2dd50ecc3833108d4089a75a242a3690f8f2547459ef6b10/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-330:{mountpoint:/var/lib/containers/storage/overlay/c5a47e5fb8e871c80afd744c05290f8e1b5d97f214a472ffabaefef0e1101ec5/merged major:0 minor:330 fsType:overlay blockSize:0} overlay_0-332:{mountpoint:/var/lib/containers/storage/overlay/291ec15b95838c704664372f699aea8e8eb8e7534fb99e5ce886e21461ed8afe/merged major:0 minor:332 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/38d9a59fb08ae1318c61ba65a15eac7205ed483acdb06dfb13797079eb8bc254/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/07ac7bc2dc634eaf723761f12e03eb140b1b1c8932785f31896b976bde9f9fa2/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/8c03db0383f29460482619337b788b723af0f58f73ce19e2e3f9bd096565d6e8/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/3ff35273081732707c5bdc0a222ab25c28610ae7cc1294b6692f328ad6328d4c/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/957a522aa98c00445a218e96db7d83570d0c81017a583275be930dc41e128155/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/e5db2bf7bdf19276860ea1e45ea01f18d80f627d257a04df69404416097f1e1c/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-379:{mountpoint:/var/lib/containers/storage/overlay/7f9f34b7115d234273d2473529fa2259ff9bd83598ae6bef5f37ab7d271c9a7f/merged major:0 minor:379 fsType:overlay blockSize:0} overlay_0-383:{mountpoint:/var/lib/containers/storage/overlay/6b64707390016493594fcfbd2972f700ef8e1e6824df0a3674c512e42cdf7f9d/merged major:0 minor:383 fsType:overlay blockSize:0} overlay_0-386:{mountpoint:/var/lib/containers/storage/overlay/afce3f5a76de95e207cd01a08423af37f9187e75363546ef5a8a49287c8f213b/merged major:0 minor:386 fsType:overlay blockSize:0} overlay_0-388:{mountpoint:/var/lib/containers/storage/overlay/c89be8ea3898b6434aead61472ae027fd7603d1f43ce5e228d2b612c0c6ade4f/merged major:0 minor:388 fsType:overlay blockSize:0} overlay_0-399:{mountpoint:/var/lib/containers/storage/overlay/656dad95ec411b279717edb528140eb69211f62e10ef75f49f89cc177fa24104/merged major:0 minor:399 fsType:overlay blockSize:0} overlay_0-404:{mountpoint:/var/lib/containers/storage/overlay/d786789e3c9d4d8edc3f8fb0d1d5e1e1db4663da5622cfd49e7336f2dde3afa9/merged major:0 minor:404 fsType:overlay blockSize:0} overlay_0-409:{mountpoint:/var/lib/containers/storage/overlay/7d623ce2b68cbf778b3a31c8f6fe22e8efdea6ac7467e8cf00a4780760df4d44/merged major:0 minor:409 fsType:overlay blockSize:0} overlay_0-416:{mountpoint:/var/lib/containers/storage/overlay/d5b621d6250071486509bfe6846c8cfdf70dfa6efe8b07ba7761d3c2f9997e6e/merged major:0 minor:416 fsType:overlay blockSize:0} overlay_0-421:{mountpoint:/var/lib/containers/storage/overlay/81022b194dbd4ddcc9f862e8a5164a181d3a081309a395af32d3f7ebf6942119/merged major:0 minor:421 fsType:overlay blockSize:0} overlay_0-423:{mountpoint:/var/lib/containers/storage/overlay/3299eafb4de5c20a42b7c94bd605d2873bdd69884cbf850ada2266fe33f51721/merged major:0 minor:423 fsType:overlay blockSize:0} overlay_0-428:{mountpoint:/var/lib/containers/storage/overlay/5a78bd45181f961bc1cbf34b95052cfaac8a24bd65e5f834c4bee72a25ba35be/merged major:0 minor:428 fsType:overlay blockSize:0} overlay_0-433:{mountpoint:/var/lib/containers/storage/overlay/4dc27bb9ac691db9bea027b09c24f03669c74116127db415c8e8d002a208b2ce/merged major:0 minor:433 fsType:overlay blockSize:0} overlay_0-455:{mountpoint:/var/lib/containers/storage/overlay/2566528599a6c0a0ce5033f70ebedbee23ccc58af0c7866dd96e0217f7338d21/merged major:0 minor:455 fsType:overlay blockSize:0} overlay_0-457:{mountpoint:/var/lib/containers/storage/overlay/2059f477b197022372e5ef58e9820114bcd5d73267efd8398125c6e2caf8e435/merged major:0 minor:457 fsType:overlay blockSize:0} overlay_0-459:{mountpoint:/var/lib/containers/storage/overlay/2df92ea49d0e9f717128a66f1248109fef6f098b8deb29d46f2d1dff05c95da7/merged major:0 minor:459 fsType:overlay blockSize:0} overlay_0-465:{mountpoint:/var/lib/containers/storage/overlay/b08cb5b8836765887d95217aef30dd38d15bc4755eb47650bf94d2401c8015db/merged major:0 minor:465 fsType:overlay blockSize:0} overlay_0-471:{mountpoint:/var/lib/containers/storage/overlay/1d5a1f3ec970f8720f24f005c5a9a139ffd4da6d62e750baaa13da37c17df529/merged major:0 minor:471 fsType:overlay blockSize:0} overlay_0-477:{mountpoint:/var/lib/containers/storage/overlay/4504a030968a49c5ddfd7f673feb75fcbeb7a380900d62f35058a9082c011548/merged major:0 minor:477 fsType:overlay blockSize:0} overlay_0-482:{mountpoint:/var/lib/containers/storage/overlay/f20e3afa140a84bc743d4d62bfbcef6317784614437313f66aa76765fcc74573/merged major:0 minor:482 fsType:overlay blockSize:0} overlay_0-487:{mountpoint:/var/lib/containers/storage/overlay/d76cbc119a93e6d6da14aef82acd4f6586804aac891c192884908f4a4531bb31/merged major:0 minor:487 fsType:overlay blockSize:0} overlay_0-493:{mountpoint:/var/lib/containers/storage/overlay/373b8a11e86cc7b439390251892c17c189efe91dba5325747fa7e411130e7e1e/merged major:0 minor:493 fsType:overlay blockSize:0} overlay_0-498:{mountpoint:/var/lib/containers/storage/overlay/db71c5a9cabc476d08411c2c8a249f39a982594d8072beeb59597cc1520fed74/merged major:0 minor:498 fsType:overlay blockSize:0} overlay_0-503:{mountpoint:/var/lib/containers/storage/overlay/7ea796d471fc34bb18a79336a63eaa26e913e15b49a4f843cbbc3ea688b24b10/merged major:0 minor:503 fsType:overlay blockSize:0} overlay_0-508:{mountpoint:/var/lib/containers/storage/overlay/eb39576093d15eb727cbc4fbb956aa42bffeaf043dc61da18a933d4a4f52a3bb/merged major:0 minor:508 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/9f68b268ebbdd364bdc32acdf2cee03821bd8b3bbc0335913dabab936d51ddf1/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-521:{mountpoint:/var/lib/containers/storage/overlay/aa5b9c6d60816404daf01fab57d005184343c9d4b43e2e4c4de0092844655f14/merged major:0 minor:521 fsType:overlay blockSize:0} overlay_0-527:{mountpoint:/var/lib/containers/storage/overlay/44ab3077bde864f99cb221dffa190afd7405e88fcea44302cc852b7dafdbafd3/merged major:0 minor:527 fsType:overlay blockSize:0} overlay_0-529:{mountpoint:/var/lib/containers/storage/overlay/9661d277c4f56758f90a1aee7a8fdc38c99ed116c177018b909c7b90df639be7/merged major:0 minor:529 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/99b476b076c8d7af548b2db18d654e48d243161ba0b7d5f5123bea4aee56fc58/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-531:{mountpoint:/var/lib/containers/storage/overlay/6b17237de21ff2ed4b765e5395b3a43fd212741156d6060090bc5b20fbf09d96/merged major:0 minor:531 fsType:overlay blockSize:0} overlay_0-533:{mountpoint:/var/lib/containers/storage/overlay/2bbd17e8094a462b4b433010f58d01875b68b883595ac5a5450c515522b8a779/merged major:0 minor:533 fsType:overlay blockSize:0} overlay_0-539:{mountpoint:/var/lib/containers/storage/overlay/f587cfade1827eab8562b6369d9a0d9e4e07c5954e9044930dd28db2fc45c7de/merged major:0 minor:539 fsType:overlay blockSize:0} overlay_0-544:{mountpoint:/var/lib/containers/storage/overlay/402de61390b82ad01fc348c7af7d28d777044b19556732f1c68ed1e7dc4f8a9f/merged major:0 minor:544 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/906ad29cee2632c1de77f81292f15f2200f706dafd09c72817474e3b8006513a/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/f64ec93d8a81ea3559e13775dd0a750d9dedd01ec2ec0e53460f03ba6f56b3ed/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/603101dedddf6174ac370b20f0d71007f58c8cd832921b17e6ef06846453a464/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/77bb35faa755a4f11815da2acb505bd110ff8412c4bf493254a6c10edd928bff/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/59e8a1516a53b4beecbae7af346faf4f67aaeb7f68e6133d1fae99f7e8c11e78/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/59f366f398e4277de992883ff16ac16362674367857dfb049380e09606161300/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/75352474d0cfefbf1d34900b8fa67fd7de6002cbd7443c5d0b8dbda4315c210c/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/86cdde8b8507d33fcf8f683cb7d0629887a8965a6e0fe9c708a30edc999d850a/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 20:39:49.201802 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.201355    6048 manager.go:217] Machine: {Timestamp:2026-10-30 20:39:49.200632959 +0000 UTC m=+0.059369243 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098856 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24def61cc7fdb7c82afd29c2917e90 SystemUUID:ec24def6-1cc7-fdb7-c82a-fd29c2917e90 BootID:8383a4c7-17c0-40f2-b96c-c59012eb6993 Filesystems:[{Device:overlay_0-477 DeviceMajor:0 DeviceMinor:477 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/189329a83c01a187b71d6763260eeceb5bafb600d957eb1c87299431e7b8dace/userdata/shm DeviceMajor:0 DeviceMinor:203 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d26003df-46f0-4d7b-bd2c-b7fe898533cd/volumes/kubernetes.io~projected/kube-api-access-dcvn9 DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:314 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:443 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-465 DeviceMajor:0 DeviceMinor:465 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-383 DeviceMajor:0 DeviceMinor:383 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-404 DeviceMajor:0 DeviceMinor:404 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:444 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-457 DeviceMajor:0 DeviceMinor:457 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-503 DeviceMajor:0 DeviceMinor:503 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-232 DeviceMajor:0 DeviceMinor:232 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:297 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:315 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-533 DeviceMajor:0 DeviceMinor:533 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/241b828d-8324-467d-9f6b-ab0c3959b895/volumes/kubernetes.io~projected/kube-api-access-99zv4 DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0ef23080-50af-4c4e-9cba-64a5c85fc4ac/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:270 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:305 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:317 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:451 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-531 DeviceMajor:0 DeviceMinor:531 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/01fae3a3-8169-40f8-b7b8-d313c96b6add/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/840bcd20-c702-4818-8e4e-0caa0ae2ffe3/volumes/kubernetes.io~projected/kube-api-access-fn92l DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:319 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-416 DeviceMajor:0 DeviceMinor:416 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:307 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1fdee27a5c298bf17ce3b450222bfcba30f451da581529672c8ba096b76f433f/userdata/shm DeviceMajor:0 DeviceMinor:49 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fbd28ece-83af-4175-a32f-774fe77aae9f/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/01fae3a3-8169-40f8-b7b8-d313c96b6add/volumes/kubernetes.io~projected/kube-api-access-5ltvz DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-214 DeviceMajor:0 DeviceMinor:214 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/49fec735c0078506dcadfb5469460fa04e272165bdb1b449697d8a8e2595f925/userdata/shm DeviceMajor:0 DeviceMinor:279 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:316 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7d0f9e3213022ec7022b9292b9f7ce51d35bf02ff1dbbf303b1236fc83eebab9/userdata/shm DeviceMajor:0 DeviceMinor:360 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-428 DeviceMajor:0 DeviceMinor:428 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:449 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:450 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-487 DeviceMajor:0 DeviceMinor:487 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5e4f8b268c9f6d8a5e2b5e60bd9542ada263daf851e3f5c91bd72b7b84146b6d/userdata/shm DeviceMajor:0 DeviceMinor:523 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8d8228f788316bce4e6637a28679a7abacfc962f7671cfacabeb6bbb7740ef5b/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-379 DeviceMajor:0 DeviceMinor:379 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~projected/kube-api-access-z8h7s DeviceMajor:0 DeviceMinor:398 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-455 DeviceMajor:0 DeviceMinor:455 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-508 DeviceMajor:0 DeviceMinor:508 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a36998df039ab2626b86c69d421e07fabd68f0507aa7e8aa2d8e9cf116e42573/userdata/shm DeviceMajor:0 DeviceMinor:525 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5638334c773411572ebc8b8f1b9175ba85ae8448c51b8704b7d40db55b4ecffa/userdata/shm DeviceMajor:0 DeviceMinor:220 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0ef23080-50af-4c4e-9cba-64a5c85fc4ac/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:272 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:308 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-321 DeviceMajor:0 DeviceMinor:321 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ba3c1bbd08e26604ed7728f99e16ccad1abb1378d83d851805e57f2e8d372276/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/18026b97-bf3c-49e4-8745-98869d8e1af2/volumes/kubernetes.io~projected/kube-api-access-c44dq DeviceMajor:0 DeviceMinor:363 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:395 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:396 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:303 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-539 DeviceMajor:0 DeviceMinor:539 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:302 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/302193ecf56ef78205adbdf4ce9f0eb6324dd7462565394da72a2404ce9a1ea9/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9e994b987cf79e6aef1f63fda9266ad24179b5f16f626a1f2b2819e48e9668ff/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d26003df-46f0-4d7b-bd2c-b7fe898533cd/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-224 DeviceMajor:0 DeviceMinor:224 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a3510fa5-8b88-4b4d-893a-f3dca0163e72/volumes/kubernetes.io~projected/kube-api-access-x6c2k DeviceMajor:0 DeviceMinor:274 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4f9b88ab371bdb0b06b12e2e8fffc8113c24f1f0fa9edbd0a65ed6657ec025d1/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fbd28ece-83af-4175-a32f-774fe77aae9f/volumes/kubernetes.io~projected/kube-api-access-98cqt DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-216 DeviceMajor:0 DeviceMinor:216 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~projected/kube-api-access-fgkj8 DeviceMajor:0 DeviceMinor:452 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-471 DeviceMajor:0 DeviceMinor:471 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-287 DeviceMajor:0 DeviceMinor:287 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:450 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-529 DeviceMajor:0 DeviceMinor:529 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:262 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~projected/kube-api-access-ckzzb DeviceMajor:0 DeviceMinor:320 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:397 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7fe042e648a2d438bfccf23709449378b3b9acb75f58e71ea91eeaa47c55313b/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/db92f8226a7e88de443efa78a8be1e82e50101613499bfb5699744a195ecfae7/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06b08ffe-ca3b-4535-8563-567227a4af3e/volumes/kubernetes.io~projected/kube-api-access-lslgj DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-243 DeviceMajor:0 DeviceMinor:243 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5f63bad1d8f45285176f20bcf7a74703ad763d136a1209e98e80c1dff56aedf9/userdata/shm DeviceMajor:0 DeviceMinor:372 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:303 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-421 DeviceMajor:0 DeviceMinor:421 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/75d9beb7d1bcd1538d136a4338682fdf81d5288863335220f95e353300476cc9/userdata/shm DeviceMajor:0 DeviceMinor:283 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:301 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:303 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d7cf877aa3e82e6f4e9180c58c4e48247012fd932f39f063b09d902f9007a03d/userdata/shm DeviceMajor:0 DeviceMinor:323 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:301 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:445 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/33b22c6f-4f13-4e54-9304-cfa57f52fbe1/volumes/kubernetes.io~projected/kube-api-access-976qn DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74/volumes/kubernetes.io~projected/kube-api-access-dl7sk DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:306 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-330 DeviceMajor:0 DeviceMinor:330 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/664f00cf-cee9-45ed-9af7-52c78892a6dd/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:351 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:442 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:304 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes/kubernetes.io~projected/kube-api-access-wk5nj DeviceMajor:0 DeviceMinor:309 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:450 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-493 DeviceMajor:0 DeviceMinor:493 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-498 DeviceMajor:0 DeviceMinor:498 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-527 DeviceMajor:0 DeviceMinor:527 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c5071a82-ea2d-426c-83da-9eae94007232/volumes/kubernetes.io~projected/kube-api-access-jkgw8 DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a3510fa5-8b88-4b4d-893a-f3dca0163e72/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:273 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9fc4adb92295d4e6016e7340547e48bb93dcea8c49a70a47e932b7d15dce8468/userdata/shm DeviceMajor:0 DeviceMinor:277 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/664f00cf-cee9-45ed-9af7-52c78892a6dd/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:350 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:448 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c/volumes/kubernetes.io~projected/kube-api-access-b5wl6 DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8c1d56b3727d63b653a5bdf6d6eff2d188146adaf217cbbc16d82acd6e4c4ff7/userdata/shm DeviceMajor:0 DeviceMinor:97 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c6ef821a-391c-4775-9cf4-f54b1a4d247d/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f01d076a-94ad-4eb5-8886-0771d5a50440/volumes/kubernetes.io~projected/kube-api-access-wlhs8 DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2f80595f08b8ae4d2913fe97ee2f206a1876f8f5453360ee98078063c4f66014/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fbd28ece-83af-4175-a32f-774fe77aae9f/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dd7ad502ab0f589a77b9964bbf0f0b218ba7cf827da748a4434d078164a3e9c4/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:271 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a3510fa5-8b88-4b4d-893a-f3dca0163e72/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:261 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:447 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c28bc8e0-d670-4b43-bab5-d51bdbe1a350/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:519 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5/volumes/kubernetes.io~projected/kube-api-access-8474p DeviceMajor:0 DeviceMinor:520 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-521 DeviceMajor:0 DeviceMinor:521 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-285 DeviceMajor:0 DeviceMinor:285 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/18026b97-bf3c-49e4-8745-98869d8e1af2/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:362 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/56bd4c4bcb76fec8354dc4462814428e2a79c1c0bd0458399b6e38502796003c/userdata/shm DeviceMajor:0 DeviceMinor:414 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-433 DeviceMajor:0 DeviceMinor:433 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/783f50999e1d0aa329095c4dd094ec456f66bb8c17988ca603eeae80f7aedecf/userdata/shm DeviceMajor:0 DeviceMinor:310 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e77e6b22-b7c0-4053-a277-baf7073c6b54/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:318 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-409 DeviceMajor:0 DeviceMinor:409 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:438 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-459 DeviceMajor:0 DeviceMinor:459 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/01fae3a3-8169-40f8-b7b8-d313c96b6add/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/241b828d-8324-467d-9f6b-ab0c3959b895/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/664f00cf-cee9-45ed-9af7-52c78892a6dd/volumes/kubernetes.io~projected/kube-api-access-lmzqj DeviceMajor:0 DeviceMinor:359 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:450 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-544 DeviceMajor:0 DeviceMinor:544 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0ef23080-50af-4c4e-9cba-64a5c85fc4ac/volumes/kubernetes.io~projected/kube-api-access-bnqtl DeviceMajor:0 DeviceMinor:275 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d/volumes/kubernetes.io~projected/kube-api-access-69v72 DeviceMajor:0 DeviceMinor:276 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7/volumes/kubernetes.io~projected/kube-api-access-95s77 DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-388 DeviceMajor:0 DeviceMinor:388 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-423 DeviceMajor:0 DeviceMinor:423 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:513 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/664f00cf-cee9-45ed-9af7-52c78892a6dd/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:358 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/034a5af7714f8d96dfc353941c3e6e0cbb00efecedb39d49fed7a4be677a2484/userdata/shm DeviceMajor:0 DeviceMinor:517 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1/volumes/kubernetes.io~projected/kube-api-access-h64qc DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/96e953c5ee9433035f75b131726e33539afad27b08b4802560262dde3af9ea68/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:303 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:394 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-482 DeviceMajor:0 DeviceMinor:482 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/06b08ffe-ca3b-4535-8563-567227a4af3e/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-332 DeviceMajor:0 DeviceMinor:332 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-386 DeviceMajor:0 DeviceMinor:386 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-399 DeviceMajor:0 DeviceMinor:399 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:446 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/854824b400eb7368254f104ec9443ac24961b9e2661a14daf75142b623240d27/userdata/shm DeviceMajor:0 DeviceMinor:453 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:034a5af7714f8d9 MacAddress:92:25:3c:4c:24:c7 Speed:10000 Mtu:8901} {Name:189329a83c01a18 MacAddress:a6:27:1a:ec:a6:63 Speed:10000 Mtu:8901} {Name:5638334c7734115 MacAddress:92:c6:4d:52:9c:8f Speed:10000 Mtu:8901} {Name:56bd4c4bcb76fec MacAddress:62:b9:75:86:a1:c5 Speed:10000 Mtu:8901} {Name:5e4f8b268c9f6d8 MacAddress:d6:04:32:ff:3e:97 Speed:10000 Mtu:8901} {Name:5f63bad1d8f4528 MacAddress:7a:ab:b3:3a:eb:8d Speed:10000 Mtu:8901} {Name:75d9beb7d1bcd15 MacAddress:9e:b6:34:9a:c7:3f Speed:10000 Mtu:8901} {Name:783f50999e1d0aa MacAddress:ce:20:5e:e4:a1:6e Speed:10000 Mtu:8901} {Name:7d0f9e3213022ec MacAddress:5a:68:97:19:ff:f4 Speed:10000 Mtu:8901} {Name:854824b400eb736 MacAddress:8a:d1:0e:f1:82:2c Speed:10000 Mtu:8901} {Name:9fc4adb92295d4e MacAddress:1e:69:98:b7:1f:fc Speed:10000 Mtu:8901} {Name:a36998df039ab26 MacAddress:9e:5b:6e:b8:30:7f Speed:10000 Mtu:8901} {Name:ba3c1bbd08e2660 MacAddress:46:03:d5:e1:b8:11 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d5:01:cf:37 Speed:0 Mtu:9001} {Name:br-int MacAddress:be:55:63:db:b7:07 Speed:0 Mtu:8901} {Name:d7cf877aa3e82e6 MacAddress:f6:da:6a:75:ab:1c Speed:10000 Mtu:8901} {Name:dd7ad502ab0f589 MacAddress:0a:07:ec:16:5b:4e Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d5:01:cf:37 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:f6:cc:3a:e5:27:ed Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:5a:0d:94:a0:67:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:39:49.201802 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.201807    6048 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:39:49.202292 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.201850    6048 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:39:49.202292 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.202216    6048 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:39:49.202427 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.202246    6048 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-162.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:39:49.202517 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.202432    6048 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:39:49.202517 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.202445    6048 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:39:49.202517 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.202459    6048 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:39:49.202517 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.202478    6048 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:39:49.202680 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.202604    6048 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:39:49.202829 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.202815    6048 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:39:49.202949 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.202937    6048 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:39:49.203009 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.202985    6048 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:39:49.203009 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.203006    6048 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:39:49.203128 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.203034    6048 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:39:49.203128 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.203048    6048 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:39:49.203128 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.203059    6048 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:39:49.203858 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.203840    6048 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:39:49.203858 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.203855    6048 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:39:49.204433 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.204400    6048 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:39:49.207937 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.207923    6048 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:39:49.207937 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.207936    6048 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:39:49.208052 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208043    6048 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 20:39:49.208258 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208245    6048 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:39:49.208309 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208283    6048 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:39:49.208389 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208379    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:39:49.208420 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208394    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:39:49.208420 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208401    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:39:49.208420 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208407    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:39:49.208420 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208412    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:39:49.208420 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208419    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:39:49.208563 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208426    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:39:49.208563 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208434    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:39:49.208563 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208441    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:39:49.208563 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208447    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:39:49.208563 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208464    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:39:49.208563 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208474    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:39:49.208563 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208497    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:39:49.208563 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.208504    6048 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:39:49.211881 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.211866    6048 server.go:1263] "Started kubelet"
Oct 30 20:39:49.211993 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.211964    6048 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:39:49.212063 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.211975    6048 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:39:49.212122 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.212088    6048 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:39:49.212437 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.212419    6048 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:39:49.212471 ip-10-0-131-162 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:39:49.213892 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.213302    6048 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:39:49.219797 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.219780    6048 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:39:49.219907 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.219817    6048 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:39:49.219907 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.219879    6048 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:33:39 +0000 UTC" deadline="2028-07-04 22:23:54.35497683 +0000 UTC"
Oct 30 20:39:49.220002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.219914    6048 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14713h44m5.135065132s"
Oct 30 20:39:49.220002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.219939    6048 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:39:49.220002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.219944    6048 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:39:49.220002 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:39:49.219971    6048 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-162.us-east-2.compute.internal\" not found"
Oct 30 20:39:49.220459 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.220235    6048 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:39:49.223120 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223075    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01fae3a3-8169-40f8-b7b8-d313c96b6add" volumeName="kubernetes.io/empty-dir/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-tuned" seLinuxMountContext=""
Oct 30 20:39:49.223120 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223119    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-main-tls" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223135    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06b08ffe-ca3b-4535-8563-567227a4af3e" volumeName="kubernetes.io/projected/06b08ffe-ca3b-4535-8563-567227a4af3e-kube-api-access-lslgj" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223149    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223162    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-config" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223175    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-main-db" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223188    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-kube-api-access-wk5nj" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223200    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9fd74d48-bbb1-4d0b-bf06-ff393896e8c3" volumeName="kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-telemeter-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223214    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9fd74d48-bbb1-4d0b-bf06-ff393896e8c3" volumeName="kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-secret-telemeter-client" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223228    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3510fa5-8b88-4b4d-893a-f3dca0163e72" volumeName="kubernetes.io/empty-dir/a3510fa5-8b88-4b4d-893a-f3dca0163e72-volume-directive-shadow" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223239    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-cluster-tls-config" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223251    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d26003df-46f0-4d7b-bd2c-b7fe898533cd" volumeName="kubernetes.io/projected/d26003df-46f0-4d7b-bd2c-b7fe898533cd-kube-api-access-dcvn9" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223263    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f81bbb61-4901-4f5b-91ec-ec15ae1fdc74" volumeName="kubernetes.io/configmap/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223274    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbd28ece-83af-4175-a32f-774fe77aae9f" volumeName="kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-ovnkube-config" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223288    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-tls" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223302    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7" volumeName="kubernetes.io/projected/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-kube-api-access-95s77" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223315    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18026b97-bf3c-49e4-8745-98869d8e1af2" volumeName="kubernetes.io/secret/18026b97-bf3c-49e4-8745-98869d8e1af2-monitoring-plugin-cert" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223327    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="664f00cf-cee9-45ed-9af7-52c78892a6dd" volumeName="kubernetes.io/configmap/664f00cf-cee9-45ed-9af7-52c78892a6dd-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223339    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223351    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-web-config" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223362    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbd28ece-83af-4175-a32f-774fe77aae9f" volumeName="kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 20:39:49.223367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223384    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ef23080-50af-4c4e-9cba-64a5c85fc4ac" volumeName="kubernetes.io/secret/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223396    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c5071a82-ea2d-426c-83da-9eae94007232" volumeName="kubernetes.io/projected/c5071a82-ea2d-426c-83da-9eae94007232-kube-api-access-jkgw8" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223408    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9fd74d48-bbb1-4d0b-bf06-ff393896e8c3" volumeName="kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-federate-client-tls" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223420    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6ef821a-391c-4775-9cf4-f54b1a4d247d" volumeName="kubernetes.io/configmap/c6ef821a-391c-4775-9cf4-f54b1a4d247d-konnectivity-ca" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223432    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="664f00cf-cee9-45ed-9af7-52c78892a6dd" volumeName="kubernetes.io/configmap/664f00cf-cee9-45ed-9af7-52c78892a6dd-metrics-server-audit-profiles" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223445    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="664f00cf-cee9-45ed-9af7-52c78892a6dd" volumeName="kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-client-ca-bundle" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223458    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223477    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-config-out" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223488    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9fd74d48-bbb1-4d0b-bf06-ff393896e8c3" volumeName="kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-telemeter-client-tls" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223500    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6bd3b39-32fc-4092-a1ec-911f4a86bd7d" volumeName="kubernetes.io/secret/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223512    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" volumeName="kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223537    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ef23080-50af-4c4e-9cba-64a5c85fc4ac" volumeName="kubernetes.io/configmap/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223552    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e77e6b22-b7c0-4053-a277-baf7073c6b54" volumeName="kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-tls" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223565    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbd28ece-83af-4175-a32f-774fe77aae9f" volumeName="kubernetes.io/secret/fbd28ece-83af-4175-a32f-774fe77aae9f-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223575    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ef23080-50af-4c4e-9cba-64a5c85fc4ac" volumeName="kubernetes.io/empty-dir/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-textfile" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223587    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="664f00cf-cee9-45ed-9af7-52c78892a6dd" volumeName="kubernetes.io/projected/664f00cf-cee9-45ed-9af7-52c78892a6dd-kube-api-access-lmzqj" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223600    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01fae3a3-8169-40f8-b7b8-d313c96b6add" volumeName="kubernetes.io/projected/01fae3a3-8169-40f8-b7b8-d313c96b6add-kube-api-access-5ltvz" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223614    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="241b828d-8324-467d-9f6b-ab0c3959b895" volumeName="kubernetes.io/configmap/241b828d-8324-467d-9f6b-ab0c3959b895-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223632    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-db" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223645    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3510fa5-8b88-4b4d-893a-f3dca0163e72" volumeName="kubernetes.io/projected/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-api-access-x6c2k" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223656    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3510fa5-8b88-4b4d-893a-f3dca0163e72" volumeName="kubernetes.io/secret/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-tls" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223668    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-config-out" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223681    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e77e6b22-b7c0-4053-a277-baf7073c6b54" volumeName="kubernetes.io/projected/e77e6b22-b7c0-4053-a277-baf7073c6b54-kube-api-access-ckzzb" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223694    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e77e6b22-b7c0-4053-a277-baf7073c6b54" volumeName="kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223707    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06b08ffe-ca3b-4535-8563-567227a4af3e" volumeName="kubernetes.io/secret/06b08ffe-ca3b-4535-8563-567227a4af3e-cert" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223719    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223731    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-kube-api-access-fgkj8" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223744    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3a3268c-635f-4eb2-a85d-f9c42a5d4db7" volumeName="kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223756    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d26003df-46f0-4d7b-bd2c-b7fe898533cd" volumeName="kubernetes.io/configmap/d26003df-46f0-4d7b-bd2c-b7fe898533cd-config-volume" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223770    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f01d076a-94ad-4eb5-8886-0771d5a50440" volumeName="kubernetes.io/configmap/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-daemon-config" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223782    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f01d076a-94ad-4eb5-8886-0771d5a50440" volumeName="kubernetes.io/projected/f01d076a-94ad-4eb5-8886-0771d5a50440-kube-api-access-wlhs8" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223793    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f81bbb61-4901-4f5b-91ec-ec15ae1fdc74" volumeName="kubernetes.io/projected/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-kube-api-access-dl7sk" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223806    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="664f00cf-cee9-45ed-9af7-52c78892a6dd" volumeName="kubernetes.io/empty-dir/664f00cf-cee9-45ed-9af7-52c78892a6dd-audit-log" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223819    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d26003df-46f0-4d7b-bd2c-b7fe898533cd" volumeName="kubernetes.io/secret/d26003df-46f0-4d7b-bd2c-b7fe898533cd-metrics-tls" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223831    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e77e6b22-b7c0-4053-a277-baf7073c6b54" volumeName="kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223853    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ef23080-50af-4c4e-9cba-64a5c85fc4ac" volumeName="kubernetes.io/secret/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-tls" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223866    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" volumeName="kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223880    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223899    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6bd3b39-32fc-4092-a1ec-911f4a86bd7d" volumeName="kubernetes.io/secret/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223912    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e77e6b22-b7c0-4053-a277-baf7073c6b54" volumeName="kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223924    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f81bbb61-4901-4f5b-91ec-ec15ae1fdc74" volumeName="kubernetes.io/secret/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223936    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f81bbb61-4901-4f5b-91ec-ec15ae1fdc74" volumeName="kubernetes.io/secret/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-prometheus-operator-tls" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223950    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18026b97-bf3c-49e4-8745-98869d8e1af2" volumeName="kubernetes.io/projected/18026b97-bf3c-49e4-8745-98869d8e1af2-kube-api-access-c44dq" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223961    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b3d2ec1-b5f3-499e-a5e2-b524d57837b5" volumeName="kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223974    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-grpc-tls" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223987    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-web-config" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.223999    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="241b828d-8324-467d-9f6b-ab0c3959b895" volumeName="kubernetes.io/empty-dir/241b828d-8324-467d-9f6b-ab0c3959b895-data-volume" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224011    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="664f00cf-cee9-45ed-9af7-52c78892a6dd" volumeName="kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-secret-metrics-server-client-certs" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224041    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="840bcd20-c702-4818-8e4e-0caa0ae2ffe3" volumeName="kubernetes.io/configmap/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-serviceca" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224053    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224065    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-metrics-client-certs" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224077    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3510fa5-8b88-4b4d-893a-f3dca0163e72" volumeName="kubernetes.io/configmap/a3510fa5-8b88-4b4d-893a-f3dca0163e72-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224089    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33b22c6f-4f13-4e54-9304-cfa57f52fbe1" volumeName="kubernetes.io/projected/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-kube-api-access-976qn" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224101    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-config-volume" seLinuxMountContext=""
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224113    6048 factory.go:153] Registering CRI-O factory
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224132    6048 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224177    6048 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224183    6048 factory.go:55] Registering systemd factory
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224191    6048 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224205    6048 factory.go:103] Registering Raw factory
Oct 30 20:39:49.224299 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224215    6048 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224487    6048 manager.go:319] Starting recovery of all containers
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.224113    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225225    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c28bc8e0-d670-4b43-bab5-d51bdbe1a350" volumeName="kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225252    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" volumeName="kubernetes.io/projected/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-kube-api-access-b5wl6" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225267    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9fd74d48-bbb1-4d0b-bf06-ff393896e8c3" volumeName="kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225281    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-tls-assets" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225294    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbd28ece-83af-4175-a32f-774fe77aae9f" volumeName="kubernetes.io/projected/fbd28ece-83af-4175-a32f-774fe77aae9f-kube-api-access-98cqt" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225309    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225324    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3510fa5-8b88-4b4d-893a-f3dca0163e72" volumeName="kubernetes.io/secret/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225336    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225348    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e77e6b22-b7c0-4053-a277-baf7073c6b54" volumeName="kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-grpc-tls" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225362    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9fd74d48-bbb1-4d0b-bf06-ff393896e8c3" volumeName="kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225374    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a732d54f-3a00-454c-a2b6-202acda05e1a" volumeName="kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225385    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6bd3b39-32fc-4092-a1ec-911f4a86bd7d" volumeName="kubernetes.io/configmap/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225398    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225410    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9fd74d48-bbb1-4d0b-bf06-ff393896e8c3" volumeName="kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225421    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3510fa5-8b88-4b4d-893a-f3dca0163e72" volumeName="kubernetes.io/configmap/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225432    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" volumeName="kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225443    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6ef821a-391c-4775-9cf4-f54b1a4d247d" volumeName="kubernetes.io/secret/c6ef821a-391c-4775-9cf4-f54b1a4d247d-agent-certs" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225458    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e77e6b22-b7c0-4053-a277-baf7073c6b54" volumeName="kubernetes.io/configmap/e77e6b22-b7c0-4053-a277-baf7073c6b54-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225470    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e77e6b22-b7c0-4053-a277-baf7073c6b54" volumeName="kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225481    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f01d076a-94ad-4eb5-8886-0771d5a50440" volumeName="kubernetes.io/configmap/f01d076a-94ad-4eb5-8886-0771d5a50440-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225494    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225505    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225518    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-tls-assets" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225531    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6bd3b39-32fc-4092-a1ec-911f4a86bd7d" volumeName="kubernetes.io/projected/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-kube-api-access-69v72" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225545    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1" volumeName="kubernetes.io/configmap/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-iptables-alerter-script" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225558    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="241b828d-8324-467d-9f6b-ab0c3959b895" volumeName="kubernetes.io/secret/241b828d-8324-467d-9f6b-ab0c3959b895-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225571    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="840bcd20-c702-4818-8e4e-0caa0ae2ffe3" volumeName="kubernetes.io/projected/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-kube-api-access-fn92l" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225583    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d26003df-46f0-4d7b-bd2c-b7fe898533cd" volumeName="kubernetes.io/empty-dir/d26003df-46f0-4d7b-bd2c-b7fe898533cd-tmp-dir" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225595    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e77e6b22-b7c0-4053-a277-baf7073c6b54" volumeName="kubernetes.io/empty-dir/e77e6b22-b7c0-4053-a277-baf7073c6b54-tmp" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225607    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbd28ece-83af-4175-a32f-774fe77aae9f" volumeName="kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-env-overrides" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225620    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01fae3a3-8169-40f8-b7b8-d313c96b6add" volumeName="kubernetes.io/empty-dir/01fae3a3-8169-40f8-b7b8-d313c96b6add-tmp" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225632    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ef23080-50af-4c4e-9cba-64a5c85fc4ac" volumeName="kubernetes.io/configmap/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225643    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="241b828d-8324-467d-9f6b-ab0c3959b895" volumeName="kubernetes.io/projected/241b828d-8324-467d-9f6b-ab0c3959b895-kube-api-access-99zv4" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225658    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9fd74d48-bbb1-4d0b-bf06-ff393896e8c3" volumeName="kubernetes.io/projected/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-kube-api-access-z8h7s" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225670    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="664f00cf-cee9-45ed-9af7-52c78892a6dd" volumeName="kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-secret-metrics-server-tls" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225682    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1" volumeName="kubernetes.io/projected/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-kube-api-access-h64qc" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225716    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225729    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0ef23080-50af-4c4e-9cba-64a5c85fc4ac" volumeName="kubernetes.io/projected/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-kube-api-access-bnqtl" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225744    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33b22c6f-4f13-4e54-9304-cfa57f52fbe1" volumeName="kubernetes.io/empty-dir/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-tmp-dir" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225755    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225774    6048 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92816bb4-0182-459b-984a-cfebd04c7f20" volumeName="kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-thanos-prometheus-http-client-file" seLinuxMountContext=""
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225786    6048 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:39:49.227124 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.225793    6048 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:39:49.229247 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.227206    6048 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:39:49.229322 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.229302    6048 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:39:49.235096 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.232762    6048 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:39:49.235096 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.232891    6048 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 20:39:49.249062 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.248997    6048 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:39:49.250800 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.250781    6048 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:39:49.250800 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.250801    6048 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:39:49.250924 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.250818    6048 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:39:49.250924 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:39:49.250847    6048 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 20:39:49.256255 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.256235    6048 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:39:49.275485 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.275454    6048 generic.go:356] "Generic (PLEG): container finished" podID="0ef23080-50af-4c4e-9cba-64a5c85fc4ac" containerID="e05ba66986e03318782c87969f63a401bc91d3052fb2815412eb9ca303981fe9" exitCode=0
Oct 30 20:39:49.295578 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.295550    6048 generic.go:356] "Generic (PLEG): container finished" podID="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" containerID="5ecd2c8b49c68534860ca83301da98b66fa82837cc212226a2011557e26367ab" exitCode=0
Oct 30 20:39:49.295578 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.295575    6048 generic.go:356] "Generic (PLEG): container finished" podID="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" containerID="e2f2dde36832146f138ff0c0dc6a389cf5760e096d1968e682c8bf63351db27d" exitCode=0
Oct 30 20:39:49.295578 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.295582    6048 generic.go:356] "Generic (PLEG): container finished" podID="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" containerID="8532392a956a80da3fe0a87818b28454cc26bbca01af2dbc9f8390ad6631fcca" exitCode=0
Oct 30 20:39:49.295787 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.295590    6048 generic.go:356] "Generic (PLEG): container finished" podID="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" containerID="da8f455b1da7eb6734df8f13c8e52914a520291f4c5407998b51ee9e607a3d71" exitCode=0
Oct 30 20:39:49.295787 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.295596    6048 generic.go:356] "Generic (PLEG): container finished" podID="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" containerID="6e9dd3232a12421a80a7004e6c24bb9d79c15af69037fe74a3d4de551d31cce0" exitCode=0
Oct 30 20:39:49.295787 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.295601    6048 generic.go:356] "Generic (PLEG): container finished" podID="9ef7dc37-98ff-436d-aa7a-e4704e2cd28c" containerID="86b459d2517c94b35d20ca2128de0d0135e6e1dad8cda83dea75f6bb78d0166b" exitCode=0
Oct 30 20:39:49.307664 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.307628    6048 generic.go:356] "Generic (PLEG): container finished" podID="c59dea9ec41d18b0bb9fc183e4c2006a" containerID="b31a137b88faf691823973749cc814340c6b31e7be5594dfb20f99c344e1c0fc" exitCode=0
Oct 30 20:39:49.311274 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.311247    6048 generic.go:356] "Generic (PLEG): container finished" podID="92816bb4-0182-459b-984a-cfebd04c7f20" containerID="b120b004a1507f1509bc531fa7f4ab70487dfbff0caefd6c3c334e2f1b82d69b" exitCode=0
Oct 30 20:39:49.319631 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.319568    6048 generic.go:356] "Generic (PLEG): container finished" podID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerID="345c7fc8a42a3e7c6578d00692ddde108c65629204a66c7276204938f496ff62" exitCode=0
Oct 30 20:39:49.350571 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.350543    6048 manager.go:324] Recovery completed
Oct 30 20:39:49.350919 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:39:49.350898    6048 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 20:39:49.378764 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.378740    6048 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:39:49.378764 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.378756    6048 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:39:49.378913 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.378776    6048 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:39:49.378913 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.378895    6048 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 20:39:49.378969 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.378905    6048 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 20:39:49.378969 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.378921    6048 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 20:39:49.378969 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.378927    6048 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 20:39:49.378969 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.378932    6048 policy_none.go:50] "Start"
Oct 30 20:39:49.378969 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.378942    6048 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:39:49.378969 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.378951    6048 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:39:49.379178 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.379137    6048 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 20:39:49.379178 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.379146    6048 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 20:39:49.379178 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.379151    6048 policy_none.go:44] "Start"
Oct 30 20:39:49.384017 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.383990    6048 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:39:49.386627 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.386614    6048 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:39:49.387332 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:39:49.386638    6048 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:39:49.387394 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.387337    6048 server.go:87] "Starting device plugin registration server"
Oct 30 20:39:49.387673 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.387661    6048 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:39:49.387708 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.387675    6048 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:39:49.387770 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.387756    6048 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:39:49.387876 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.387850    6048 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:39:49.387936 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.387896    6048 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:39:49.387936 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.387904    6048 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:39:49.388065 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.387972    6048 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:39:49.387875256Z","UUID":"2c90e7bd-eaef-4d52-9fbd-a456468a79e7","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:39:49.389330 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.389310    6048 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:39:49.389413 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.389340    6048 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:39:49.389802 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:39:49.389753    6048 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:39:49.488324 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.488292    6048 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:39:49.490579 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.490560    6048 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:39:49.490674 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.490593    6048 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:39:49.490674 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.490604    6048 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-162.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:39:49.490674 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.490666    6048 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.504568 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.504539    6048 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.504679 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.504611    6048 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.551016 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.550955    6048 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"]
Oct 30 20:39:49.551675 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.551659    6048 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.551754 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.551679    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal" event={"ID":"079b2b48b74377f18062751235dbf291","Type":"ContainerStarted","Data":"a513a041a1457172d296213cba4ba482b4ea671fb414abc34049dbacc8800d32"}
Oct 30 20:39:49.551754 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.551719    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal" event={"ID":"079b2b48b74377f18062751235dbf291","Type":"ContainerStarted","Data":"1fdee27a5c298bf17ce3b450222bfcba30f451da581529672c8ba096b76f433f"}
Oct 30 20:39:49.551754 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.551732    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal" event={"ID":"c59dea9ec41d18b0bb9fc183e4c2006a","Type":"ContainerStarted","Data":"3ddfcdcde43caf31e082c6453a4102f4547d956f15899f86ca37f8c98f21c251"}
Oct 30 20:39:49.551754 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.551745    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal" event={"ID":"c59dea9ec41d18b0bb9fc183e4c2006a","Type":"ContainerDied","Data":"b31a137b88faf691823973749cc814340c6b31e7be5594dfb20f99c344e1c0fc"}
Oct 30 20:39:49.551962 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.551757    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal" event={"ID":"c59dea9ec41d18b0bb9fc183e4c2006a","Type":"ContainerStarted","Data":"4f9b88ab371bdb0b06b12e2e8fffc8113c24f1f0fa9edbd0a65ed6657ec025d1"}
Oct 30 20:39:49.551962 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.551924    6048 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.565883 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.565866    6048 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:39:49.565969 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:39:49.565905    6048 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.566463 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.566448    6048 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:39:49.566538 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:39:49.566489    6048 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.634836 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.634765    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c59dea9ec41d18b0bb9fc183e4c2006a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"c59dea9ec41d18b0bb9fc183e4c2006a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.634836 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.634802    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c59dea9ec41d18b0bb9fc183e4c2006a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"c59dea9ec41d18b0bb9fc183e4c2006a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.634836 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.634825    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/079b2b48b74377f18062751235dbf291-config\") pod \"kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"079b2b48b74377f18062751235dbf291\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.735442 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.735401    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c59dea9ec41d18b0bb9fc183e4c2006a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"c59dea9ec41d18b0bb9fc183e4c2006a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.735442 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.735444    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c59dea9ec41d18b0bb9fc183e4c2006a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"c59dea9ec41d18b0bb9fc183e4c2006a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.735596 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.735463    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/079b2b48b74377f18062751235dbf291-config\") pod \"kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"079b2b48b74377f18062751235dbf291\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.735596 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.735503    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c59dea9ec41d18b0bb9fc183e4c2006a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"c59dea9ec41d18b0bb9fc183e4c2006a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.735596 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.735505    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/079b2b48b74377f18062751235dbf291-config\") pod \"kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"079b2b48b74377f18062751235dbf291\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:49.735596 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:49.735510    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c59dea9ec41d18b0bb9fc183e4c2006a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" (UID: \"c59dea9ec41d18b0bb9fc183e4c2006a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:50.204126 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.204094    6048 apiserver.go:52] "Watching apiserver"
Oct 30 20:39:50.221546 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.221520    6048 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:39:50.222263 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.222242    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-45j6n","openshift-monitoring/metrics-server-59bcb84677-sjv66","openshift-monitoring/telemeter-client-75d988bc69-vl9jp","openshift-monitoring/prometheus-k8s-0","openshift-monitoring/node-exporter-x5lps","kube-system/konnectivity-agent-lvlkq","openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj","openshift-multus/multus-4cmph","openshift-ovn-kubernetes/ovnkube-node-kjpxk","openshift-cluster-node-tuning-operator/tuned-zbxjw","openshift-monitoring/thanos-querier-96c4fbf99-4dtvx","openshift-ingress-canary/ingress-canary-wcfkv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal","openshift-multus/multus-additional-cni-plugins-dnqc4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t","openshift-dns/node-resolver-zv2n9","openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr","openshift-network-diagnostics/network-check-target-g5cnl","kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal","openshift-dns/dns-default-bd9vt","openshift-insights/insights-runtime-extractor-44r9j","openshift-monitoring/alertmanager-main-0","openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg","kube-system/global-pull-secret-syncer-8p5hf","openshift-multus/network-metrics-daemon-d4pmp","openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t","openshift-network-operator/iptables-alerter-5qtnx"]
Oct 30 20:39:50.228123 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.228096    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:39:50.228241 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.228134    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:39:50.228241 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.228105    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:39:50.228241 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.228175    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:39:50.228241 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.228142    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:39:50.228241 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.228105    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:39:50.228570 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.228544    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:39:50.228675 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.228587    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:39:50.229497 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.229470    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nxdl7\""
Oct 30 20:39:50.229497 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.229485    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:39:50.229497 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.229473    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6zzqh\""
Oct 30 20:39:50.229772 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.229664    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:39:50.229829 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.229797    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-r8zbf\""
Oct 30 20:39:50.229929 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.229909    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jrnvk\""
Oct 30 20:39:50.231263 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.231244    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:39:50.231380 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.231280    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z6v2d\""
Oct 30 20:39:50.231380 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.231308    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:39:50.231999 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.231980    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:39:50.231999 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.231981    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-r2q8w\""
Oct 30 20:39:50.232201 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.232185    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:39:50.233107 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.233086    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-q55wr\""
Oct 30 20:39:50.233107 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.233101    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-wzc24\""
Oct 30 20:39:50.233257 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.233230    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cctqn\""
Oct 30 20:39:50.233653 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.233607    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9r6zk\""
Oct 30 20:39:50.233754 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.233695    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:39:50.233754 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.233695    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:39:50.233754 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.233734    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:39:50.233906 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.233800    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:39:50.233906 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.233866    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:39:50.233988 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.233917    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:39:50.234065 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.234006    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:39:50.234065 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.234014    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:39:50.234065 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.234017    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mnk4k\""
Oct 30 20:39:50.234065 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.234049    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:39:50.235167 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.235148    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:39:50.235373 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.235355    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:39:50.235458 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.235355    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:39:50.235458 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.235441    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:39:50.235458 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.235440    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:39:50.235616 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.235492    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:39:50.235616 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.235565    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:39:50.235694 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.235677    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9s58x\""
Oct 30 20:39:50.235918 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.235900    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kxrnf\""
Oct 30 20:39:50.237010 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.236357    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:39:50.237010 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.236357    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:39:50.237010 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.236361    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:39:50.237010 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.236364    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:39:50.237010 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.236429    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gk5pt\""
Oct 30 20:39:50.237010 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.236746    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:39:50.237010 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.236906    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:39:50.237010 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.236961    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:39:50.237010 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.236978    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:39:50.237482 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.237061    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:39:50.237482 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.237111    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:39:50.237482 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.237138    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:39:50.237482 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.237186    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 20:39:50.237482 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.237203    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6gb67\""
Oct 30 20:39:50.237482 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.237269    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 20:39:50.237482 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.237307    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:39:50.239076 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.239043    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zvmst\""
Oct 30 20:39:50.239182 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.239165    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 20:39:50.239615 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.239593    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 20:39:50.241037 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.241003    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 20:39:50.241116 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.241097    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 20:39:50.241163 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.241113    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 20:39:50.241221 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.241205    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 20:39:50.241265 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.241242    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rmftm\""
Oct 30 20:39:50.241418 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.241403    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-82zqq\""
Oct 30 20:39:50.241637 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.241623    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 20:39:50.242168 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.242151    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 20:39:50.242359 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.242346    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-85g6n\""
Oct 30 20:39:50.242489 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.242471    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 20:39:50.244602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244581    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 20:39:50.244691 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244620    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 20:39:50.244691 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244628    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 20:39:50.244691 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244635    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 20:39:50.244691 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244652    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 20:39:50.244691 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244684    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 20:39:50.244942 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244693    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 20:39:50.244942 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244753    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 20:39:50.244942 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244770    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hjsfp\""
Oct 30 20:39:50.244942 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244776    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-31m0mj31dkhmr\""
Oct 30 20:39:50.244942 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244770    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 20:39:50.244942 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244799    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 20:39:50.244942 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244826    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 20:39:50.244942 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244833    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 20:39:50.244942 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.244927    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 20:39:50.246141 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.246121    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 20:39:50.246141 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.246135    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 20:39:50.246141 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.246140    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 20:39:50.246349 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.246172    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nhl26\""
Oct 30 20:39:50.246349 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.246196    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b234hd2ptmdnb\""
Oct 30 20:39:50.246349 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.246238    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-s3n8t903060b\""
Oct 30 20:39:50.250271 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.250207    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 20:39:50.251473 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251454    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 20:39:50.251557 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251536    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 20:39:50.251606 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251588    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 20:39:50.251606 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251596    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 20:39:50.251685 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251614    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 20:39:50.251685 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251624    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 20:39:50.251685 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251632    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 20:39:50.251685 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251640    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 20:39:50.251805 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251774    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 20:39:50.251852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251803    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 20:39:50.251852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251811    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rwtrp\""
Oct 30 20:39:50.251852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251803    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 20:39:50.251852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251825    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 20:39:50.251852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251839    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 20:39:50.251852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251849    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 20:39:50.252122 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251860    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 20:39:50.252122 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251865    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-795h6\""
Oct 30 20:39:50.252122 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251903    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 20:39:50.252122 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.251978    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 20:39:50.252963 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.252943    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-h47d2\""
Oct 30 20:39:50.252963 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.252945    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 20:39:50.253102 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.253090    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wlqc8\""
Oct 30 20:39:50.253379 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.253364    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 20:39:50.253430 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.253416    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 20:39:50.256835 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.256824    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 20:39:50.257421 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.257409    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 20:39:50.323170 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.323145    6048 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:39:50.324285 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.324268    6048 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:50.324341 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.324333    6048 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:50.335149 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.335127    6048 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:39:50.335284 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:39:50.335185    6048 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:50.335699 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.335683    6048 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:39:50.335781 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:39:50.335719    6048 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-162.us-east-2.compute.internal"
Oct 30 20:39:50.337995 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.337975    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-serving-certs-ca-bundle\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.338070 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338005    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-run-netns\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.338070 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338033    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-node-log\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.338070 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338049    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.338226 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338146    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-sys-fs\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.338226 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338166    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95s77\" (UniqueName: \"kubernetes.io/projected/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-kube-api-access-95s77\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:50.338226 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338202    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8474p\" (UniqueName: \"kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p\") pod \"network-check-target-g5cnl\" (UID: \"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5\") " pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:50.338370 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338243    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-cni-bin\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.338370 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338269    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c44dq\" (UniqueName: \"kubernetes.io/projected/18026b97-bf3c-49e4-8745-98869d8e1af2-kube-api-access-c44dq\") pod \"monitoring-plugin-77f4f76594-pfxgr\" (UID: \"18026b97-bf3c-49e4-8745-98869d8e1af2\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:50.338370 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338288    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-registration-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.338370 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338278    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-serving-certs-ca-bundle\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.338370 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338332    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-textfile\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.338579 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338456    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ltvz\" (UniqueName: \"kubernetes.io/projected/01fae3a3-8169-40f8-b7b8-d313c96b6add-kube-api-access-5ltvz\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.338579 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338478    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-textfile\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.338579 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338487    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d26003df-46f0-4d7b-bd2c-b7fe898533cd-metrics-tls\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:50.338579 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338519    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.338715 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338633    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-config-out\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.338715 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338658    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.338715 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338685    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-federate-client-tls\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.338715 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338703    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-cni-bin\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.338889 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338718    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbd28ece-83af-4175-a32f-774fe77aae9f-ovn-node-metrics-cert\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.338889 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338725    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d26003df-46f0-4d7b-bd2c-b7fe898533cd-metrics-tls\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:50.338889 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338725    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.338889 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338732    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-metrics-client-ca\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.338889 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338782    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:50.338889 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338788    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-config-out\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.338889 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.338885    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.339344 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.339316    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.339344 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.339325    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-federate-client-tls\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.339494 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.339377    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:50.339494 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.339394    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbd28ece-83af-4175-a32f-774fe77aae9f-ovn-node-metrics-cert\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.339494 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.339406    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-metrics-client-ca\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.339957 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.339932    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.340134 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340079    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzzb\" (UniqueName: \"kubernetes.io/projected/e77e6b22-b7c0-4053-a277-baf7073c6b54-kube-api-access-ckzzb\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.340212 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340160    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-secret-metrics-server-tls\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.340212 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340198    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.340327 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340228    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-host-slash\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:39:50.340327 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340304    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.340449 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340432    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.340499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340473    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.340559 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340540    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-secret-metrics-server-tls\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.340719 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340702    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.340789 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340715    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.340789 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340763    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.340896 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340807    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-web-config\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.340896 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340841    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-ovn\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.340896 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340873    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cni-binary-copy\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.341084 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.340899    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-env-overrides\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.341153 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341084    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-env-overrides\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.341153 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341104    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.341153 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341139    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-systemd\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.341307 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341181    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.341307 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341249    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.341307 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341282    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-log-socket\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.341307 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341298    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-web-config\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.341555 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341310    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-kubernetes\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.341555 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341358    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.341555 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341423    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.341555 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341455    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98cqt\" (UniqueName: \"kubernetes.io/projected/fbd28ece-83af-4175-a32f-774fe77aae9f-kube-api-access-98cqt\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.341555 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341486    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-sys\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.341555 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341538    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.341865 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341574    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/241b828d-8324-467d-9f6b-ab0c3959b895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:50.341865 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341600    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-system-cni-dir\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.341865 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341632    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.341865 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.341661    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.342087 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.342044    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.342526 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.342505    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.342608 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.342587    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.342810 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.342783    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/241b828d-8324-467d-9f6b-ab0c3959b895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:50.342810 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.342787    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.342938 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.342888    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.342998 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.342950    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-etc-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.342998 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.342991    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:50.343128 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343002    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.343128 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343017    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-hostroot\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.343255 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343236    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:50.343316 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343287    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysctl-conf\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.343376 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343325    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e77e6b22-b7c0-4053-a277-baf7073c6b54-metrics-client-ca\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.343443 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343392    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.343443 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343419    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn92l\" (UniqueName: \"kubernetes.io/projected/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-kube-api-access-fn92l\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:39:50.343547 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343450    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-sys\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.343547 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343482    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3510fa5-8b88-4b4d-893a-f3dca0163e72-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:50.343664 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343559    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-cni-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.343664 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343592    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-host\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.343664 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343647    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:50.343823 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343683    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnqtl\" (UniqueName: \"kubernetes.io/projected/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-kube-api-access-bnqtl\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.343823 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343721    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.343823 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343765    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/664f00cf-cee9-45ed-9af7-52c78892a6dd-metrics-server-audit-profiles\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.343985 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343841    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.343985 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343879    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-systemd\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.343985 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343923    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-serviceca\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:39:50.343985 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343964    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c6ef821a-391c-4775-9cf4-f54b1a4d247d-konnectivity-ca\") pod \"konnectivity-agent-lvlkq\" (UID: \"c6ef821a-391c-4775-9cf4-f54b1a4d247d\") " pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:39:50.344197 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.343999    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcvn9\" (UniqueName: \"kubernetes.io/projected/d26003df-46f0-4d7b-bd2c-b7fe898533cd-kube-api-access-dcvn9\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:50.344197 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344049    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-config-out\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.344197 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344082    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-web-config\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.344197 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344097    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3510fa5-8b88-4b4d-893a-f3dca0163e72-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:50.344197 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344116    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-secret-metrics-server-client-certs\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.344197 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344190    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-hosts-file\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:39:50.344523 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344397    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.344523 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344394    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/664f00cf-cee9-45ed-9af7-52c78892a6dd-metrics-server-audit-profiles\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.344523 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344467    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.344523 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344480    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e77e6b22-b7c0-4053-a277-baf7073c6b54-metrics-client-ca\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.344523 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344498    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h64qc\" (UniqueName: \"kubernetes.io/projected/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-kube-api-access-h64qc\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:39:50.344758 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344533    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c6ef821a-391c-4775-9cf4-f54b1a4d247d-agent-certs\") pod \"konnectivity-agent-lvlkq\" (UID: \"c6ef821a-391c-4775-9cf4-f54b1a4d247d\") " pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:39:50.344758 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344568    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.344758 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344598    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c6ef821a-391c-4775-9cf4-f54b1a4d247d-konnectivity-ca\") pod \"konnectivity-agent-lvlkq\" (UID: \"c6ef821a-391c-4775-9cf4-f54b1a4d247d\") " pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:39:50.344758 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344626    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-original-pull-secret\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:50.344953 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344799    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-config-out\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.344953 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344821    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-socket-dir-parent\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.344953 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344846    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-secret-metrics-server-client-certs\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.344953 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344900    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-config-volume\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.344953 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344918    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c6ef821a-391c-4775-9cf4-f54b1a4d247d-agent-certs\") pod \"konnectivity-agent-lvlkq\" (UID: \"c6ef821a-391c-4775-9cf4-f54b1a4d247d\") " pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:39:50.344953 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344921    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-web-config\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.344953 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344951    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmzqj\" (UniqueName: \"kubernetes.io/projected/664f00cf-cee9-45ed-9af7-52c78892a6dd-kube-api-access-lmzqj\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.345265 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344985    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.345265 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.344989    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.345538 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345503    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-serviceca\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:39:50.345538 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345528    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:50.345693 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345564    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-daemon-config\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.345693 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345590    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lslgj\" (UniqueName: \"kubernetes.io/projected/06b08ffe-ca3b-4535-8563-567227a4af3e-kube-api-access-lslgj\") pod \"ingress-canary-wcfkv\" (UID: \"06b08ffe-ca3b-4535-8563-567227a4af3e\") " pod="openshift-ingress-canary/ingress-canary-wcfkv"
Oct 30 20:39:50.345693 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345632    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-run\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.345693 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345532    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-config-volume\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.345693 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345659    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk5nj\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-kube-api-access-wk5nj\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.345917 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345705    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:50.345917 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345726    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-976qn\" (UniqueName: \"kubernetes.io/projected/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-kube-api-access-976qn\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:39:50.345917 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345795    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-daemon-config\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.345917 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345830    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/241b828d-8324-467d-9f6b-ab0c3959b895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:50.346110 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345937    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a3510fa5-8b88-4b4d-893a-f3dca0163e72-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:50.346110 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345972    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-k8s-cni-cncf-io\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.346110 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.345999    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-tls\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.346110 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346035    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a3510fa5-8b88-4b4d-893a-f3dca0163e72-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:50.346110 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346048    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.346110 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346050    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/241b828d-8324-467d-9f6b-ab0c3959b895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:50.346110 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346085    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-wtmp\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.346414 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346156    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:50.346414 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346237    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d26003df-46f0-4d7b-bd2c-b7fe898533cd-config-volume\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:50.346414 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346275    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.346414 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346299    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.346414 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346289    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-tls\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.346659 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346422    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgkj8\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-kube-api-access-fgkj8\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.346659 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346452    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/664f00cf-cee9-45ed-9af7-52c78892a6dd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.346659 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346465    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d26003df-46f0-4d7b-bd2c-b7fe898533cd-config-volume\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:50.346659 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346470    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-kubelet\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.346659 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346480    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:50.346659 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346510    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-slash\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.346659 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346511    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.346659 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346600    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-var-lib-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.346659 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346617    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-socket-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.346659 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346633    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/664f00cf-cee9-45ed-9af7-52c78892a6dd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.346659 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346642    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:50.347103 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346675    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-tls\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.347103 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346766    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-conf-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.347103 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346808    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:50.347103 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346847    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18026b97-bf3c-49e4-8745-98869d8e1af2-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pfxgr\" (UID: \"18026b97-bf3c-49e4-8745-98869d8e1af2\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:50.347103 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346880    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8h7s\" (UniqueName: \"kubernetes.io/projected/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-kube-api-access-z8h7s\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.347103 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346888    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-tls\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.347103 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.346924    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-multus-certs\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.347103 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347010    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlhs8\" (UniqueName: \"kubernetes.io/projected/f01d076a-94ad-4eb5-8886-0771d5a50440-kube-api-access-wlhs8\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.347103 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347059    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/18026b97-bf3c-49e4-8745-98869d8e1af2-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-pfxgr\" (UID: \"18026b97-bf3c-49e4-8745-98869d8e1af2\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:50.347103 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347062    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:50.347499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347163    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.347499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347201    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.347499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347213    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:50.347499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347232    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.347499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347259    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-kubelet-config\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:50.347499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347283    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/241b828d-8324-467d-9f6b-ab0c3959b895-crio-socket\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:50.347499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347335    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.347499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347389    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99zv4\" (UniqueName: \"kubernetes.io/projected/241b828d-8324-467d-9f6b-ab0c3959b895-kube-api-access-99zv4\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:50.347499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347401    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.347499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347407    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.347499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347414    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cnibin\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347536    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-lib-modules\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347577    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347596    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-netns\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347614    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-modprobe-d\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347634    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347730    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-tmp-dir\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347795    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347803    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347819    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-tmp-dir\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347822    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-etc-kubernetes\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347864    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d26003df-46f0-4d7b-bd2c-b7fe898533cd-tmp-dir\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347904    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347931    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d26003df-46f0-4d7b-bd2c-b7fe898533cd-tmp-dir\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:50.347966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.347971    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348008    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-client-ca-bundle\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348050    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-system-cni-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348091    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348091    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-cni-multus\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348149    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-var-lib-kubelet\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348180    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348189    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348206    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/664f00cf-cee9-45ed-9af7-52c78892a6dd-client-ca-bundle\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348237    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-secret-telemeter-client\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348274    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkgw8\" (UniqueName: \"kubernetes.io/projected/c5071a82-ea2d-426c-83da-9eae94007232-kube-api-access-jkgw8\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348306    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348399    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348448    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-secret-telemeter-client\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348492    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-dbus\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348545    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348579    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.348597 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348595    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348612    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-cni-netd\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348638    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-device-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348763    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/241b828d-8324-467d-9f6b-ab0c3959b895-data-volume\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348810    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06b08ffe-ca3b-4535-8563-567227a4af3e-cert\") pod \"ingress-canary-wcfkv\" (UID: \"06b08ffe-ca3b-4535-8563-567227a4af3e\") " pod="openshift-ingress-canary/ingress-canary-wcfkv"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348819    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348826    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ltvz\" (UniqueName: \"kubernetes.io/projected/01fae3a3-8169-40f8-b7b8-d313c96b6add-kube-api-access-5ltvz\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348852    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/241b828d-8324-467d-9f6b-ab0c3959b895-data-volume\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348871    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348879    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-tuned\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348912    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-grpc-tls\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348947    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-systemd-units\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348951    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-tuned\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348965    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348982    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06b08ffe-ca3b-4535-8563-567227a4af3e-cert\") pod \"ingress-canary-wcfkv\" (UID: \"06b08ffe-ca3b-4535-8563-567227a4af3e\") " pod="openshift-ingress-canary/ingress-canary-wcfkv"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.348990    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01fae3a3-8169-40f8-b7b8-d313c96b6add-tmp\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349012    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-config\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349052    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01fae3a3-8169-40f8-b7b8-d313c96b6add-tmp\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349081    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349098    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-iptables-alerter-script\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349125    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6c2k\" (UniqueName: \"kubernetes.io/projected/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-api-access-x6c2k\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349132    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8474p\" (UniqueName: \"kubernetes.io/projected/1b3d2ec1-b5f3-499e-a5e2-b524d57837b5-kube-api-access-8474p\") pod \"network-check-target-g5cnl\" (UID: \"1b3d2ec1-b5f3-499e-a5e2-b524d57837b5\") " pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349140    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5wl6\" (UniqueName: \"kubernetes.io/projected/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-kube-api-access-b5wl6\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349163    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c44dq\" (UniqueName: \"kubernetes.io/projected/18026b97-bf3c-49e4-8745-98869d8e1af2-kube-api-access-c44dq\") pod \"monitoring-plugin-77f4f76594-pfxgr\" (UID: \"18026b97-bf3c-49e4-8745-98869d8e1af2\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349179    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysctl-d\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349206    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349219    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349221    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e77e6b22-b7c0-4053-a277-baf7073c6b54-secret-grpc-tls\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349259    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349277    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/664f00cf-cee9-45ed-9af7-52c78892a6dd-audit-log\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349371    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl7sk\" (UniqueName: \"kubernetes.io/projected/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-kube-api-access-dl7sk\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349392    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-iptables-alerter-script\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349406    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/664f00cf-cee9-45ed-9af7-52c78892a6dd-audit-log\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349411    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-kubelet\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.349519 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349416    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-config\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349611    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349641    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-telemeter-client-tls\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349670    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349697    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysconfig\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349722    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349748    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69v72\" (UniqueName: \"kubernetes.io/projected/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-kube-api-access-69v72\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349956    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.349996    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350048    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350074    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350132    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-metrics-client-ca\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350226    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-ovnkube-config\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350262    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-ovnkube-script-lib\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350307    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-root\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350333    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350369    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-telemeter-client-tls\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350378    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350472    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350549    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350580    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350587    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f01d076a-94ad-4eb5-8886-0771d5a50440-cni-binary-copy\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350615    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-metrics-client-ca\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350653    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350700    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350748    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350756    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-host\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350835    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350841    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f01d076a-94ad-4eb5-8886-0771d5a50440-cni-binary-copy\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350846    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350866    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-ovnkube-config\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350875    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-cnibin\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350912    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e77e6b22-b7c0-4053-a277-baf7073c6b54-tmp\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350979    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbd28ece-83af-4175-a32f-774fe77aae9f-ovnkube-script-lib\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350988    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-metrics-certs\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:50.351094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.350986    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e77e6b22-b7c0-4053-a277-baf7073c6b54-tmp\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.352279 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.351395    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95s77\" (UniqueName: \"kubernetes.io/projected/b3a3268c-635f-4eb2-a85d-f9c42a5d4db7-kube-api-access-95s77\") pod \"network-metrics-daemon-d4pmp\" (UID: \"b3a3268c-635f-4eb2-a85d-f9c42a5d4db7\") " pod="openshift-multus/network-metrics-daemon-d4pmp"
Oct 30 20:39:50.352279 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.351779    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckzzb\" (UniqueName: \"kubernetes.io/projected/e77e6b22-b7c0-4053-a277-baf7073c6b54-kube-api-access-ckzzb\") pod \"thanos-querier-96c4fbf99-4dtvx\" (UID: \"e77e6b22-b7c0-4053-a277-baf7073c6b54\") " pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:50.356454 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.356438    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98cqt\" (UniqueName: \"kubernetes.io/projected/fbd28ece-83af-4175-a32f-774fe77aae9f-kube-api-access-98cqt\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.360828 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.360802    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-976qn\" (UniqueName: \"kubernetes.io/projected/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-kube-api-access-976qn\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:39:50.360980 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.360955    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn92l\" (UniqueName: \"kubernetes.io/projected/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-kube-api-access-fn92l\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:39:50.361578 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.361557    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h64qc\" (UniqueName: \"kubernetes.io/projected/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-kube-api-access-h64qc\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:39:50.361651 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.361560    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnqtl\" (UniqueName: \"kubernetes.io/projected/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-kube-api-access-bnqtl\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.361889 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.361867    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcvn9\" (UniqueName: \"kubernetes.io/projected/d26003df-46f0-4d7b-bd2c-b7fe898533cd-kube-api-access-dcvn9\") pod \"dns-default-bd9vt\" (UID: \"d26003df-46f0-4d7b-bd2c-b7fe898533cd\") " pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:50.362396 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.362376    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgkj8\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-kube-api-access-fgkj8\") pod \"prometheus-k8s-0\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:50.362679 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.362660    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lslgj\" (UniqueName: \"kubernetes.io/projected/06b08ffe-ca3b-4535-8563-567227a4af3e-kube-api-access-lslgj\") pod \"ingress-canary-wcfkv\" (UID: \"06b08ffe-ca3b-4535-8563-567227a4af3e\") " pod="openshift-ingress-canary/ingress-canary-wcfkv"
Oct 30 20:39:50.362733 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.362660    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmzqj\" (UniqueName: \"kubernetes.io/projected/664f00cf-cee9-45ed-9af7-52c78892a6dd-kube-api-access-lmzqj\") pod \"metrics-server-59bcb84677-sjv66\" (UID: \"664f00cf-cee9-45ed-9af7-52c78892a6dd\") " pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:39:50.362908 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.362893    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk5nj\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-kube-api-access-wk5nj\") pod \"alertmanager-main-0\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:39:50.367133 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.367085    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5wl6\" (UniqueName: \"kubernetes.io/projected/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-kube-api-access-b5wl6\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.367236 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.367139    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkgw8\" (UniqueName: \"kubernetes.io/projected/c5071a82-ea2d-426c-83da-9eae94007232-kube-api-access-jkgw8\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.367297 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.367265    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlhs8\" (UniqueName: \"kubernetes.io/projected/f01d076a-94ad-4eb5-8886-0771d5a50440-kube-api-access-wlhs8\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.367348 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.367333    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6c2k\" (UniqueName: \"kubernetes.io/projected/a3510fa5-8b88-4b4d-893a-f3dca0163e72-kube-api-access-x6c2k\") pod \"kube-state-metrics-5dc8d7d89b-vfn4t\" (UID: \"a3510fa5-8b88-4b4d-893a-f3dca0163e72\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-vfn4t"
Oct 30 20:39:50.367400 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.367344    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69v72\" (UniqueName: \"kubernetes.io/projected/c6bd3b39-32fc-4092-a1ec-911f4a86bd7d-kube-api-access-69v72\") pod \"openshift-state-metrics-7bd7489957-vvjwg\" (UID: \"c6bd3b39-32fc-4092-a1ec-911f4a86bd7d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-vvjwg"
Oct 30 20:39:50.367400 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.367364    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl7sk\" (UniqueName: \"kubernetes.io/projected/f81bbb61-4901-4f5b-91ec-ec15ae1fdc74-kube-api-access-dl7sk\") pod \"prometheus-operator-9cd89b74c-cdmsj\" (UID: \"f81bbb61-4901-4f5b-91ec-ec15ae1fdc74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-cdmsj"
Oct 30 20:39:50.368018 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.367997    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99zv4\" (UniqueName: \"kubernetes.io/projected/241b828d-8324-467d-9f6b-ab0c3959b895-kube-api-access-99zv4\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:50.368243 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.368223    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8h7s\" (UniqueName: \"kubernetes.io/projected/9fd74d48-bbb1-4d0b-bf06-ff393896e8c3-kube-api-access-z8h7s\") pod \"telemeter-client-75d988bc69-vl9jp\" (UID: \"9fd74d48-bbb1-4d0b-bf06-ff393896e8c3\") " pod="openshift-monitoring/telemeter-client-75d988bc69-vl9jp"
Oct 30 20:39:50.451656 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451621    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-hosts-file\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:39:50.451656 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451655    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.451834 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451674    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-socket-dir-parent\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.451834 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451739    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-socket-dir-parent\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.451834 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451736    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.451834 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451748    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.451834 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451766    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.451834 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451778    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-run\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.451834 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451740    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/33b22c6f-4f13-4e54-9304-cfa57f52fbe1-hosts-file\") pod \"node-resolver-zv2n9\" (UID: \"33b22c6f-4f13-4e54-9304-cfa57f52fbe1\") " pod="openshift-dns/node-resolver-zv2n9"
Oct 30 20:39:50.451834 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451798    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-k8s-cni-cncf-io\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.451834 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451815    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-wtmp\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451840    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-kubelet\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451849    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-run\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451863    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-slash\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451868    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-k8s-cni-cncf-io\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451884    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-kubelet\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451891    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-var-lib-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451910    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-slash\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451921    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-socket-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451924    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-var-lib-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451947    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-conf-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451960    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-node-exporter-wtmp\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451966    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-socket-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451975    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-multus-certs\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.451995    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-conf-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452003    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-kubelet-config\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452005    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-multus-certs\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452045    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/241b828d-8324-467d-9f6b-ab0c3959b895-crio-socket\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452065    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cnibin\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452079    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-lib-modules\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452097    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/241b828d-8324-467d-9f6b-ab0c3959b895-crio-socket\") pod \"insights-runtime-extractor-44r9j\" (UID: \"241b828d-8324-467d-9f6b-ab0c3959b895\") " pod="openshift-insights/insights-runtime-extractor-44r9j"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452103    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-kubelet-config\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452117    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-cnibin\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452141    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-netns\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452152 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452159    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-modprobe-d\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452178    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-etc-kubernetes\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452184    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-run-netns\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452190    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-lib-modules\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452204    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-system-cni-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452223    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-etc-kubernetes\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452224    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-cni-multus\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452245    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-var-lib-kubelet\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452254    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-cni-multus\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452256    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-system-cni-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452267    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-dbus\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452266    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-modprobe-d\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452286    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-var-lib-kubelet\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452300    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-cni-netd\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452313    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c28bc8e0-d670-4b43-bab5-d51bdbe1a350-dbus\") pod \"global-pull-secret-syncer-8p5hf\" (UID: \"c28bc8e0-d670-4b43-bab5-d51bdbe1a350\") " pod="kube-system/global-pull-secret-syncer-8p5hf"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452325    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-device-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452346    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-systemd-units\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452362    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452385    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysctl-d\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452402    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-kubelet\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452403    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-device-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452404    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-cni-netd\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452435    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-systemd-units\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452446    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452459    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysconfig\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452480    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-kubelet\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452493    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-root\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452509    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysctl-d\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452514    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-host\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452537    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/840bcd20-c702-4818-8e4e-0caa0ae2ffe3-host\") pod \"node-ca-45j6n\" (UID: \"840bcd20-c702-4818-8e4e-0caa0ae2ffe3\") " pod="openshift-image-registry/node-ca-45j6n"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452545    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysconfig\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452543    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-cnibin\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452548    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-root\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452636    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-cnibin\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452636    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-run-netns\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452656    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-run-netns\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452658    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-node-log\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452675    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-node-log\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452682    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452704    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-sys-fs\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452723    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452730    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-cni-bin\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452762    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-registration-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452777    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-host-var-lib-cni-bin\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452796    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-sys-fs\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452800    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-cni-bin\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452834    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-registration-dir\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452836    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-cni-bin\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452833    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452869    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c5071a82-ea2d-426c-83da-9eae94007232-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgw4t\" (UID: \"c5071a82-ea2d-426c-83da-9eae94007232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgw4t"
Oct 30 20:39:50.452859 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452881    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-host-slash\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452900    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-ovn\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452911    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1-host-slash\") pod \"iptables-alerter-5qtnx\" (UID: \"0c4b5665-fa3f-4a84-ac04-ee8ca7eb18c1\") " pod="openshift-network-operator/iptables-alerter-5qtnx"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452921    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-systemd\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452941    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-ovn\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452945    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-log-socket\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452965    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-kubernetes\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452971    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-systemd\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.452999    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453008    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-log-socket\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453036    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-sys\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453057    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-system-cni-dir\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453074    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453061    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-kubernetes\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453083    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-etc-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453090    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-sys\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453095    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ef7dc37-98ff-436d-aa7a-e4704e2cd28c-system-cni-dir\") pod \"multus-additional-cni-plugins-dnqc4\" (UID: \"9ef7dc37-98ff-436d-aa7a-e4704e2cd28c\") " pod="openshift-multus/multus-additional-cni-plugins-dnqc4"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453113    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-hostroot\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453112    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-etc-openvswitch\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453133    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysctl-conf\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453151    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-sys\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453175    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-hostroot\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453181    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-cni-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453205    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-host\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453223    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-systemd\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453277    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ef23080-50af-4c4e-9cba-64a5c85fc4ac-sys\") pod \"node-exporter-x5lps\" (UID: \"0ef23080-50af-4c4e-9cba-64a5c85fc4ac\") " pod="openshift-monitoring/node-exporter-x5lps"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453280    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f01d076a-94ad-4eb5-8886-0771d5a50440-multus-cni-dir\") pod \"multus-4cmph\" (UID: \"f01d076a-94ad-4eb5-8886-0771d5a50440\") " pod="openshift-multus/multus-4cmph"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453291    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-host\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453283    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd28ece-83af-4175-a32f-774fe77aae9f-run-systemd\") pod \"ovnkube-node-kjpxk\" (UID: \"fbd28ece-83af-4175-a32f-774fe77aae9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:50.454305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.453331    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01fae3a3-8169-40f8-b7b8-d313c96b6add-etc-sysctl-conf\") pod \"tuned-zbxjw\" (UID: \"01fae3a3-8169-40f8-b7b8-d313c96b6add\") " pod="openshift-cluster-node-tuning-operator/tuned-zbxjw"
Oct 30 20:39:50.915214 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:50.915187    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-pfxgr"
Oct 30 20:39:52.079572 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:52.079541    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bd9vt"
Oct 30 20:39:52.715850 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:52.715811    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:39:53.671541 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:53.671514    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:53.741341 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:53.741313    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:39:54.342665 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:54.342639    6048 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:39:55.438096 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:55.438068    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-96c4fbf99-4dtvx"
Oct 30 20:39:55.690693 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:55.690612    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:39:58.843699 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:39:58.843668    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-59bcb84677-sjv66"
Oct 30 20:40:03.527439 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:03.527350    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:40:03.528556 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:03.528511    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="config-reloader" containerID="cri-o://fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7" gracePeriod=120
Oct 30 20:40:03.528767 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:03.528490    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="kube-rbac-proxy-web" containerID="cri-o://ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a" gracePeriod=120
Oct 30 20:40:03.528888 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:03.528505    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="alertmanager" containerID="cri-o://84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b" gracePeriod=120
Oct 30 20:40:03.528888 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:03.528486    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="kube-rbac-proxy" containerID="cri-o://f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc" gracePeriod=120
Oct 30 20:40:03.528888 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:03.528555    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="prom-label-proxy" containerID="cri-o://f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963" gracePeriod=120
Oct 30 20:40:03.529035 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:03.528605    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="kube-rbac-proxy-metric" containerID="cri-o://abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd" gracePeriod=120
Oct 30 20:40:04.384508 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.384473    6048 generic.go:356] "Generic (PLEG): container finished" podID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerID="f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963" exitCode=0
Oct 30 20:40:04.384508 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.384500    6048 generic.go:356] "Generic (PLEG): container finished" podID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerID="abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd" exitCode=0
Oct 30 20:40:04.384508 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.384507    6048 generic.go:356] "Generic (PLEG): container finished" podID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerID="f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc" exitCode=0
Oct 30 20:40:04.384508 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.384514    6048 generic.go:356] "Generic (PLEG): container finished" podID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerID="fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7" exitCode=0
Oct 30 20:40:04.384508 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.384519    6048 generic.go:356] "Generic (PLEG): container finished" podID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerID="84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b" exitCode=0
Oct 30 20:40:04.384795 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.384538    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerDied","Data":"f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963"}
Oct 30 20:40:04.384795 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.384604    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerDied","Data":"abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd"}
Oct 30 20:40:04.384795 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.384629    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerDied","Data":"f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc"}
Oct 30 20:40:04.384795 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.384652    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerDied","Data":"fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7"}
Oct 30 20:40:04.384795 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.384676    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerDied","Data":"84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b"}
Oct 30 20:40:04.771508 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.771480    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:04.879031 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.878992    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-web-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-web-config\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.879170 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.879060    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-tls-assets\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-tls-assets\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.879170 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.879091    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-cluster-tls-config\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.879170 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.879132    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-main-tls\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.879170 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.879151    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.879411 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.879283    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-web\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.879411 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.879348    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-trusted-ca-bundle\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.879411 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.879395    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-metrics-client-ca\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.879564 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.879429    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-main-db\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.879564 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.879487    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-config-out\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-config-out\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.879564 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.879517    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.879564 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.879552    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-kube-api-access-wk5nj\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-kube-api-access-wk5nj\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.879759 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.879581    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-config-volume\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-config-volume\") pod \"a732d54f-3a00-454c-a2b6-202acda05e1a\" (UID: \"a732d54f-3a00-454c-a2b6-202acda05e1a\") "
Oct 30 20:40:04.881303 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.880209    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-main-db" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:40:04.881303 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.880587    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-trusted-ca-bundle" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:04.881303 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.881042    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-metrics-client-ca" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:04.882204 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.882156    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:04.882741 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.882602    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-main-tls" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:04.882741 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.882661    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-tls-assets" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:04.882741 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.882699    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-web" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:04.882975 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.882910    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-config-volume" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:04.883569 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.883545    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-metric" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:04.883975 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.883945    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-config-out" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:40:04.884380 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.884363    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-kube-api-access-wk5nj" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "kube-api-access-wk5nj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:04.886824 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.886803    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-cluster-tls-config" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:04.893474 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.893452    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-web-config" pod "a732d54f-3a00-454c-a2b6-202acda05e1a" (UID: "a732d54f-3a00-454c-a2b6-202acda05e1a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:04.980469 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980400    6048 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-tls-assets\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:04.980469 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980427    6048 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-cluster-tls-config\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:04.980469 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980439    6048 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-main-tls\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:04.980469 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980450    6048 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:04.980469 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980460    6048 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:04.980469 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980469    6048 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:04.980745 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980480    6048 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a732d54f-3a00-454c-a2b6-202acda05e1a-metrics-client-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:04.980745 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980500    6048 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-alertmanager-main-db\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:04.980745 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980510    6048 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a732d54f-3a00-454c-a2b6-202acda05e1a-config-out\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:04.980745 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980520    6048 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:04.980745 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980530    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk5nj\" (UniqueName: \"kubernetes.io/projected/a732d54f-3a00-454c-a2b6-202acda05e1a-kube-api-access-wk5nj\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:04.980745 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980540    6048 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-config-volume\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:04.980745 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:04.980551    6048 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a732d54f-3a00-454c-a2b6-202acda05e1a-web-config\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:05.392392 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.392361    6048 generic.go:356] "Generic (PLEG): container finished" podID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerID="ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a" exitCode=0
Oct 30 20:40:05.392549 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.392450    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.392549 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.392442    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerDied","Data":"ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a"}
Oct 30 20:40:05.392619 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.392590    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a732d54f-3a00-454c-a2b6-202acda05e1a","Type":"ContainerDied","Data":"783f50999e1d0aa329095c4dd094ec456f66bb8c17988ca603eeae80f7aedecf"}
Oct 30 20:40:05.392656 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.392624    6048 scope.go:122] "RemoveContainer" containerID="f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963"
Oct 30 20:40:05.401654 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.401630    6048 scope.go:122] "RemoveContainer" containerID="abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd"
Oct 30 20:40:05.408448 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.408425    6048 scope.go:122] "RemoveContainer" containerID="f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc"
Oct 30 20:40:05.415093 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.415076    6048 scope.go:122] "RemoveContainer" containerID="ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a"
Oct 30 20:40:05.417038 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.417000    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:40:05.421542 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.421523    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:40:05.423091 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.423073    6048 scope.go:122] "RemoveContainer" containerID="fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7"
Oct 30 20:40:05.429725 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.429710    6048 scope.go:122] "RemoveContainer" containerID="84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b"
Oct 30 20:40:05.437271 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.437251    6048 scope.go:122] "RemoveContainer" containerID="345c7fc8a42a3e7c6578d00692ddde108c65629204a66c7276204938f496ff62"
Oct 30 20:40:05.444510 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.444494    6048 scope.go:122] "RemoveContainer" containerID="f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963"
Oct 30 20:40:05.444772 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:05.444750    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963\": container with ID starting with f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963 not found: ID does not exist" containerID="f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963"
Oct 30 20:40:05.444837 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.444780    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963"} err="failed to get container status \"f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963\": rpc error: code = NotFound desc = could not find container \"f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963\": container with ID starting with f1d94a86640046d3caf5db54509ecb7541e9f1e2b28bbf4b0690f65307df6963 not found: ID does not exist"
Oct 30 20:40:05.444837 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.444812    6048 scope.go:122] "RemoveContainer" containerID="abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd"
Oct 30 20:40:05.445063 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:05.445046    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd\": container with ID starting with abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd not found: ID does not exist" containerID="abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd"
Oct 30 20:40:05.445118 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.445070    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd"} err="failed to get container status \"abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd\": rpc error: code = NotFound desc = could not find container \"abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd\": container with ID starting with abe4951ee4c596b9b991d98e0a77e40ec5fb429bee842b0e9e111a3f1e4c17fd not found: ID does not exist"
Oct 30 20:40:05.445118 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.445084    6048 scope.go:122] "RemoveContainer" containerID="f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc"
Oct 30 20:40:05.445340 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:05.445323    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc\": container with ID starting with f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc not found: ID does not exist" containerID="f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc"
Oct 30 20:40:05.445379 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.445345    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc"} err="failed to get container status \"f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc\": rpc error: code = NotFound desc = could not find container \"f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc\": container with ID starting with f7dbf7ac7357abd1f1b28cf678e67e99c0bf968ba271baee53779a5278172dcc not found: ID does not exist"
Oct 30 20:40:05.445379 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.445368    6048 scope.go:122] "RemoveContainer" containerID="ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a"
Oct 30 20:40:05.445610 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:05.445596    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a\": container with ID starting with ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a not found: ID does not exist" containerID="ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a"
Oct 30 20:40:05.445656 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.445613    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a"} err="failed to get container status \"ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a\": rpc error: code = NotFound desc = could not find container \"ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a\": container with ID starting with ac417ffef9527133584923f4a73b94cc203ac7ddbe22b06ced12046f7fa7171a not found: ID does not exist"
Oct 30 20:40:05.445656 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.445625    6048 scope.go:122] "RemoveContainer" containerID="fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7"
Oct 30 20:40:05.445834 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:05.445818    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7\": container with ID starting with fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7 not found: ID does not exist" containerID="fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7"
Oct 30 20:40:05.445872 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.445837    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7"} err="failed to get container status \"fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7\": rpc error: code = NotFound desc = could not find container \"fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7\": container with ID starting with fc3971ec7905973cdd90007fe6b3c356205d7072feda7f6d425851d3d928b1a7 not found: ID does not exist"
Oct 30 20:40:05.445872 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.445849    6048 scope.go:122] "RemoveContainer" containerID="84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b"
Oct 30 20:40:05.446046 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:05.446032    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b\": container with ID starting with 84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b not found: ID does not exist" containerID="84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b"
Oct 30 20:40:05.446089 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.446049    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b"} err="failed to get container status \"84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b\": rpc error: code = NotFound desc = could not find container \"84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b\": container with ID starting with 84414e172155420f4e75d033b145093a51a6681b2b19c5205152859428ac437b not found: ID does not exist"
Oct 30 20:40:05.446089 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.446061    6048 scope.go:122] "RemoveContainer" containerID="345c7fc8a42a3e7c6578d00692ddde108c65629204a66c7276204938f496ff62"
Oct 30 20:40:05.446239 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:05.446224    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"345c7fc8a42a3e7c6578d00692ddde108c65629204a66c7276204938f496ff62\": container with ID starting with 345c7fc8a42a3e7c6578d00692ddde108c65629204a66c7276204938f496ff62 not found: ID does not exist" containerID="345c7fc8a42a3e7c6578d00692ddde108c65629204a66c7276204938f496ff62"
Oct 30 20:40:05.446277 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.446243    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"345c7fc8a42a3e7c6578d00692ddde108c65629204a66c7276204938f496ff62"} err="failed to get container status \"345c7fc8a42a3e7c6578d00692ddde108c65629204a66c7276204938f496ff62\": rpc error: code = NotFound desc = could not find container \"345c7fc8a42a3e7c6578d00692ddde108c65629204a66c7276204938f496ff62\": container with ID starting with 345c7fc8a42a3e7c6578d00692ddde108c65629204a66c7276204938f496ff62 not found: ID does not exist"
Oct 30 20:40:05.451322 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451302    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:40:05.451632 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451620    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="alertmanager"
Oct 30 20:40:05.451672 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451634    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="alertmanager"
Oct 30 20:40:05.451672 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451649    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="kube-rbac-proxy-web"
Oct 30 20:40:05.451672 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451654    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="kube-rbac-proxy-web"
Oct 30 20:40:05.451672 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451660    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="init-config-reloader"
Oct 30 20:40:05.451672 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451665    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="init-config-reloader"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451680    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="prom-label-proxy"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451685    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="prom-label-proxy"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451692    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="kube-rbac-proxy-metric"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451697    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="kube-rbac-proxy-metric"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451707    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="kube-rbac-proxy"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451712    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="kube-rbac-proxy"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451719    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="config-reloader"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451723    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="config-reloader"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451767    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="alertmanager"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451774    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="kube-rbac-proxy-web"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451781    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="init-config-reloader"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451789    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="prom-label-proxy"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451794    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="kube-rbac-proxy-metric"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451800    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="kube-rbac-proxy"
Oct 30 20:40:05.451814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.451806    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" containerName="config-reloader"
Oct 30 20:40:05.454824 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.454809    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.460961 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.460942    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 20:40:05.461088 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.460985    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 20:40:05.461286 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.461254    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 20:40:05.461286 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.461277    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 20:40:05.461421 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.461297    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 20:40:05.462913 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.462894    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 20:40:05.462913 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.462901    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 20:40:05.463129 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.463112    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 20:40:05.463185 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.463146    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 20:40:05.463185 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.463168    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hjsfp\""
Oct 30 20:40:05.476082 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.476004    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:40:05.584779 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.584751    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.584939 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.584800    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.584939 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.584882    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.584939 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.584902    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad485b24-958c-48d0-a14c-bcae7226371c-config-out\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.585074 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.585014    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad485b24-958c-48d0-a14c-bcae7226371c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.585108 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.585078    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.585108 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.585101    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad485b24-958c-48d0-a14c-bcae7226371c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.585166 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.585125    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-web-config\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.585166 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.585145    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad485b24-958c-48d0-a14c-bcae7226371c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.585224 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.585207    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.585256 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.585228    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.585291 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.585258    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad485b24-958c-48d0-a14c-bcae7226371c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.585291 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.585283    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckrr9\" (UniqueName: \"kubernetes.io/projected/ad485b24-958c-48d0-a14c-bcae7226371c-kube-api-access-ckrr9\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686232 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686198    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad485b24-958c-48d0-a14c-bcae7226371c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686232 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686233    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686454 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686253    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad485b24-958c-48d0-a14c-bcae7226371c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686454 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686306    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-web-config\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686454 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686321    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad485b24-958c-48d0-a14c-bcae7226371c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686454 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686341    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686454 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686358    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686454 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686382    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad485b24-958c-48d0-a14c-bcae7226371c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686454 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686401    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckrr9\" (UniqueName: \"kubernetes.io/projected/ad485b24-958c-48d0-a14c-bcae7226371c-kube-api-access-ckrr9\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686454 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686443    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686712 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686482    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686712 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686510    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686712 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686532    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad485b24-958c-48d0-a14c-bcae7226371c-config-out\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.686898 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686866    6048 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:40:05.687058 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.686964    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad485b24-958c-48d0-a14c-bcae7226371c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.687143 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.687117    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad485b24-958c-48d0-a14c-bcae7226371c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.687867 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.687844    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad485b24-958c-48d0-a14c-bcae7226371c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.689707 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.689681    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad485b24-958c-48d0-a14c-bcae7226371c-config-out\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.689822 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.689797    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.689886 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.689824    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.690009 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.689980    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.690193 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.690177    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.690193 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.690183    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-web-config\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.690401 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.690383    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.690453 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.690390    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad485b24-958c-48d0-a14c-bcae7226371c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.691529 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.691505    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad485b24-958c-48d0-a14c-bcae7226371c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.699481 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.699462    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckrr9\" (UniqueName: \"kubernetes.io/projected/ad485b24-958c-48d0-a14c-bcae7226371c-kube-api-access-ckrr9\") pod \"alertmanager-main-0\" (UID: \"ad485b24-958c-48d0-a14c-bcae7226371c\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:05.772319 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:05.772283    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:40:06.056646 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:06.056616    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:40:06.060402 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:40:06.060376    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad485b24_958c_48d0_a14c_bcae7226371c.slice/crio-978f2369ff2dc295fafc104b95a7e2aaf380a6b5b3cb94352586f474e8730551 WatchSource:0}: Error finding container 978f2369ff2dc295fafc104b95a7e2aaf380a6b5b3cb94352586f474e8730551: Status 404 returned error can't find the container with id 978f2369ff2dc295fafc104b95a7e2aaf380a6b5b3cb94352586f474e8730551
Oct 30 20:40:06.397388 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:06.397297    6048 generic.go:356] "Generic (PLEG): container finished" podID="ad485b24-958c-48d0-a14c-bcae7226371c" containerID="f701477fa5a2a25c55d8abe75949816699205fee1addf012c21f4b27dc9f3768" exitCode=0
Oct 30 20:40:06.397561 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:06.397386    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad485b24-958c-48d0-a14c-bcae7226371c","Type":"ContainerDied","Data":"f701477fa5a2a25c55d8abe75949816699205fee1addf012c21f4b27dc9f3768"}
Oct 30 20:40:06.397561 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:06.397506    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad485b24-958c-48d0-a14c-bcae7226371c","Type":"ContainerStarted","Data":"978f2369ff2dc295fafc104b95a7e2aaf380a6b5b3cb94352586f474e8730551"}
Oct 30 20:40:06.506312 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:06.506291    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lvlkq"
Oct 30 20:40:07.257674 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.256885    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a732d54f-3a00-454c-a2b6-202acda05e1a" path="/var/lib/kubelet/pods/a732d54f-3a00-454c-a2b6-202acda05e1a/volumes"
Oct 30 20:40:07.405665 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.405627    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad485b24-958c-48d0-a14c-bcae7226371c","Type":"ContainerStarted","Data":"219a50e50c61578f0ce467196ba8ceaa96786ce82a00c0bb38b2aa25ff1dacf2"}
Oct 30 20:40:07.405825 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.405696    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad485b24-958c-48d0-a14c-bcae7226371c","Type":"ContainerStarted","Data":"1e047a54b4c62cb84c04fa808cd9693b52c92ea42ed75806ee1ba42d23f1ac54"}
Oct 30 20:40:07.405825 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.405727    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad485b24-958c-48d0-a14c-bcae7226371c","Type":"ContainerStarted","Data":"ae4f5719eea8f66c4be96af00d64423fcfd9be6bede02b9d04c647695b904103"}
Oct 30 20:40:07.405825 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.405754    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad485b24-958c-48d0-a14c-bcae7226371c","Type":"ContainerStarted","Data":"1462fefec27b453778f7b008898744dfbe55dfcd145c9076efe36eda927fc319"}
Oct 30 20:40:07.405825 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.405786    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad485b24-958c-48d0-a14c-bcae7226371c","Type":"ContainerStarted","Data":"f394a5cae03b6c4f9c2da90587231e741de81d59632d30c13c9f3427c941be04"}
Oct 30 20:40:07.405825 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.405810    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad485b24-958c-48d0-a14c-bcae7226371c","Type":"ContainerStarted","Data":"a95f6764c9915299ae2cdfe2e89990106a55b37bdaef06169e63969f7c321f01"}
Oct 30 20:40:07.440665 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.440599    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.428004103 podStartE2EDuration="2.440580708s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.576605ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:40:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:40:07.438769358 +0000 UTC m=+18.297505650" watchObservedRunningTime="2026-10-30 20:40:07.440580708 +0000 UTC m=+18.299317003"
Oct 30 20:40:07.792477 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.792441    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 20:40:07.792960 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.792892    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="prometheus" containerID="cri-o://1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103" gracePeriod=600
Oct 30 20:40:07.793515 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.793205    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="kube-rbac-proxy-web" containerID="cri-o://02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b" gracePeriod=600
Oct 30 20:40:07.793515 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.793247    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="config-reloader" containerID="cri-o://cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125" gracePeriod=600
Oct 30 20:40:07.793515 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.793375    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="kube-rbac-proxy-thanos" containerID="cri-o://59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c" gracePeriod=600
Oct 30 20:40:07.793515 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.793394    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="thanos-sidecar" containerID="cri-o://ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd" gracePeriod=600
Oct 30 20:40:07.793515 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:07.793395    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="kube-rbac-proxy" containerID="cri-o://e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82" gracePeriod=600
Oct 30 20:40:08.413261 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:08.413225    6048 generic.go:356] "Generic (PLEG): container finished" podID="92816bb4-0182-459b-984a-cfebd04c7f20" containerID="59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c" exitCode=0
Oct 30 20:40:08.413261 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:08.413254    6048 generic.go:356] "Generic (PLEG): container finished" podID="92816bb4-0182-459b-984a-cfebd04c7f20" containerID="e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82" exitCode=0
Oct 30 20:40:08.413261 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:08.413260    6048 generic.go:356] "Generic (PLEG): container finished" podID="92816bb4-0182-459b-984a-cfebd04c7f20" containerID="ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd" exitCode=0
Oct 30 20:40:08.413261 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:08.413267    6048 generic.go:356] "Generic (PLEG): container finished" podID="92816bb4-0182-459b-984a-cfebd04c7f20" containerID="cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125" exitCode=0
Oct 30 20:40:08.413732 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:08.413272    6048 generic.go:356] "Generic (PLEG): container finished" podID="92816bb4-0182-459b-984a-cfebd04c7f20" containerID="1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103" exitCode=0
Oct 30 20:40:08.413732 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:08.413294    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerDied","Data":"59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c"}
Oct 30 20:40:08.413732 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:08.413385    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerDied","Data":"e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82"}
Oct 30 20:40:08.413732 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:08.413411    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerDied","Data":"ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd"}
Oct 30 20:40:08.413732 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:08.413437    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerDied","Data":"cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125"}
Oct 30 20:40:08.413732 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:08.413460    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerDied","Data":"1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103"}
Oct 30 20:40:09.039235 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.039211    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.117962 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.117920    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-tls-assets\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-tls-assets\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.117962 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.117956    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-kube-api-access-fgkj8\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-kube-api-access-fgkj8\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.118199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.117990    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-web-config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-web-config\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.118199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.118009    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-1\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.118199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.118059    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-0\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.118199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.118098    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-2\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.118199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.118133    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-grpc-tls\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.118199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.118162    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-metrics-client-ca\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.118515 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.118203    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-config-out\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-config-out\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.118515 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.118488    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-2" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:09.118722 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.118642    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-metrics-client-ca" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:09.118820 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.118772    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-1" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:09.120129 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120099    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-0" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:09.120249 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120133    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-db\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.120249 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120174    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-thanos-prometheus-http-client-file\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.120249 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120217    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-config\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.120430 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120260    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-trusted-ca-bundle\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.120430 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120303    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-kube-rbac-proxy\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.120430 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120347    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-serving-certs-ca-bundle\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.120430 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120375    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-tls\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.120430 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120410    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.120693 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120447    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-metrics-client-certs\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.120693 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120476    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.120693 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120505    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-kubelet-serving-ca-bundle\") pod \"92816bb4-0182-459b-984a-cfebd04c7f20\" (UID: \"92816bb4-0182-459b-984a-cfebd04c7f20\") "
Oct 30 20:40:09.120849 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120763    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-trusted-ca-bundle" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:09.120849 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120773    6048 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.120849 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120814    6048 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.121000 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120852    6048 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.121000 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.120869    6048 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-metrics-client-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.121853 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.121825    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-kubelet-serving-ca-bundle" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:09.122521 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.122495    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-db" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:40:09.122730 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.122709    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-serving-certs-ca-bundle" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:40:09.123231 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.123201    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-tls-assets" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:09.123657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.123632    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-tls" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:09.123746 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.123711    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-kube-api-access-fgkj8" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "kube-api-access-fgkj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:40:09.123818 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.123767    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-config-out" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:40:09.123893 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.123870    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-grpc-tls" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:09.124201 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.124178    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-config" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:09.125308 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.125279    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-thanos-sidecar-tls" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:09.125418 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.125399    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-thanos-prometheus-http-client-file" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:09.125560 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.125543    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-kube-rbac-proxy-web" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:09.125760 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.125740    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-kube-rbac-proxy" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:09.126736 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.126721    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-metrics-client-certs" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:09.134147 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.134125    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-web-config" pod "92816bb4-0182-459b-984a-cfebd04c7f20" (UID: "92816bb4-0182-459b-984a-cfebd04c7f20"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:40:09.222199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222119    6048 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222149    6048 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222163    6048 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222174    6048 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-metrics-client-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222184    6048 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222195    6048 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222204    6048 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-tls-assets\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222518 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222215    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgkj8\" (UniqueName: \"kubernetes.io/projected/92816bb4-0182-459b-984a-cfebd04c7f20-kube-api-access-fgkj8\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222518 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222224    6048 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-web-config\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222518 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222232    6048 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-grpc-tls\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222518 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222241    6048 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-config-out\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222518 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222249    6048 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-k8s-db\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222518 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222259    6048 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222518 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222267    6048 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-config\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222518 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222276    6048 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92816bb4-0182-459b-984a-cfebd04c7f20-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.222518 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.222284    6048 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92816bb4-0182-459b-984a-cfebd04c7f20-secret-kube-rbac-proxy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:40:09.419578 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.419547    6048 generic.go:356] "Generic (PLEG): container finished" podID="92816bb4-0182-459b-984a-cfebd04c7f20" containerID="02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b" exitCode=0
Oct 30 20:40:09.420062 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.419590    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerDied","Data":"02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b"}
Oct 30 20:40:09.420062 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.419638    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.420062 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.419660    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92816bb4-0182-459b-984a-cfebd04c7f20","Type":"ContainerDied","Data":"854824b400eb7368254f104ec9443ac24961b9e2661a14daf75142b623240d27"}
Oct 30 20:40:09.420062 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.419694    6048 scope.go:122] "RemoveContainer" containerID="59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c"
Oct 30 20:40:09.427288 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.427271    6048 scope.go:122] "RemoveContainer" containerID="e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82"
Oct 30 20:40:09.433957 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.433938    6048 scope.go:122] "RemoveContainer" containerID="02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b"
Oct 30 20:40:09.440488 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.440460    6048 scope.go:122] "RemoveContainer" containerID="ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd"
Oct 30 20:40:09.443383 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.442896    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 20:40:09.448140 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.448119    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 20:40:09.451950 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.451926    6048 scope.go:122] "RemoveContainer" containerID="cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125"
Oct 30 20:40:09.462408 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.462383    6048 scope.go:122] "RemoveContainer" containerID="1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103"
Oct 30 20:40:09.469909 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.469891    6048 scope.go:122] "RemoveContainer" containerID="b120b004a1507f1509bc531fa7f4ab70487dfbff0caefd6c3c334e2f1b82d69b"
Oct 30 20:40:09.476971 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.476950    6048 scope.go:122] "RemoveContainer" containerID="59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c"
Oct 30 20:40:09.477309 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:09.477285    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c\": container with ID starting with 59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c not found: ID does not exist" containerID="59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c"
Oct 30 20:40:09.477367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.477319    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c"} err="failed to get container status \"59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c\": rpc error: code = NotFound desc = could not find container \"59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c\": container with ID starting with 59b7a77efab433c5219cae295eafbb739e730b559223f1e7ef0ce5cc4ac3646c not found: ID does not exist"
Oct 30 20:40:09.477367 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.477343    6048 scope.go:122] "RemoveContainer" containerID="e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82"
Oct 30 20:40:09.477614 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:09.477594    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82\": container with ID starting with e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82 not found: ID does not exist" containerID="e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82"
Oct 30 20:40:09.477666 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.477621    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82"} err="failed to get container status \"e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82\": rpc error: code = NotFound desc = could not find container \"e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82\": container with ID starting with e53ed5d49b73aab70efcf9fb301a7f73fc012b6d6c68610da420a49ba9209d82 not found: ID does not exist"
Oct 30 20:40:09.477666 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.477639    6048 scope.go:122] "RemoveContainer" containerID="02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b"
Oct 30 20:40:09.477900 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:09.477882    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b\": container with ID starting with 02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b not found: ID does not exist" containerID="02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b"
Oct 30 20:40:09.477946 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.477902    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b"} err="failed to get container status \"02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b\": rpc error: code = NotFound desc = could not find container \"02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b\": container with ID starting with 02ecc11ea42bfb41e140a1a2707ea549411114ee789dd54609e969e4c646e51b not found: ID does not exist"
Oct 30 20:40:09.477946 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.477915    6048 scope.go:122] "RemoveContainer" containerID="ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd"
Oct 30 20:40:09.478152 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:09.478136    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd\": container with ID starting with ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd not found: ID does not exist" containerID="ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd"
Oct 30 20:40:09.478211 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.478155    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd"} err="failed to get container status \"ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd\": rpc error: code = NotFound desc = could not find container \"ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd\": container with ID starting with ea496884c266c3032b26bf66256c7aef4cc65fa4eddad2ea80a945acd6f8b7cd not found: ID does not exist"
Oct 30 20:40:09.478211 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.478168    6048 scope.go:122] "RemoveContainer" containerID="cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125"
Oct 30 20:40:09.478369 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:09.478355    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125\": container with ID starting with cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125 not found: ID does not exist" containerID="cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125"
Oct 30 20:40:09.478404 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.478372    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125"} err="failed to get container status \"cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125\": rpc error: code = NotFound desc = could not find container \"cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125\": container with ID starting with cca54f993cee432937708bb293a0b23d126d1129fd53a6bfe51e1cf885a0c125 not found: ID does not exist"
Oct 30 20:40:09.478404 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.478387    6048 scope.go:122] "RemoveContainer" containerID="1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103"
Oct 30 20:40:09.478577 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:09.478560    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103\": container with ID starting with 1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103 not found: ID does not exist" containerID="1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103"
Oct 30 20:40:09.478613 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.478580    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103"} err="failed to get container status \"1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103\": rpc error: code = NotFound desc = could not find container \"1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103\": container with ID starting with 1b5be852105be7fb296646c7ad75852e773d0c53696228707857d354c754b103 not found: ID does not exist"
Oct 30 20:40:09.478613 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.478592    6048 scope.go:122] "RemoveContainer" containerID="b120b004a1507f1509bc531fa7f4ab70487dfbff0caefd6c3c334e2f1b82d69b"
Oct 30 20:40:09.478795 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:09.478780    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b120b004a1507f1509bc531fa7f4ab70487dfbff0caefd6c3c334e2f1b82d69b\": container with ID starting with b120b004a1507f1509bc531fa7f4ab70487dfbff0caefd6c3c334e2f1b82d69b not found: ID does not exist" containerID="b120b004a1507f1509bc531fa7f4ab70487dfbff0caefd6c3c334e2f1b82d69b"
Oct 30 20:40:09.478829 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.478799    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b120b004a1507f1509bc531fa7f4ab70487dfbff0caefd6c3c334e2f1b82d69b"} err="failed to get container status \"b120b004a1507f1509bc531fa7f4ab70487dfbff0caefd6c3c334e2f1b82d69b\": rpc error: code = NotFound desc = could not find container \"b120b004a1507f1509bc531fa7f4ab70487dfbff0caefd6c3c334e2f1b82d69b\": container with ID starting with b120b004a1507f1509bc531fa7f4ab70487dfbff0caefd6c3c334e2f1b82d69b not found: ID does not exist"
Oct 30 20:40:09.485150 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485013    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 20:40:09.485366 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485351    6048 cpu_manager.go:414] "containerMap: removing container" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="kube-rbac-proxy-thanos"
Oct 30 20:40:09.485417 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485368    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="kube-rbac-proxy-thanos"
Oct 30 20:40:09.485417 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485377    6048 cpu_manager.go:414] "containerMap: removing container" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="kube-rbac-proxy-web"
Oct 30 20:40:09.485417 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485382    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="kube-rbac-proxy-web"
Oct 30 20:40:09.485417 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485398    6048 cpu_manager.go:414] "containerMap: removing container" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="kube-rbac-proxy"
Oct 30 20:40:09.485417 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485403    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="kube-rbac-proxy"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485420    6048 cpu_manager.go:414] "containerMap: removing container" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="init-config-reloader"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485425    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="init-config-reloader"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485435    6048 cpu_manager.go:414] "containerMap: removing container" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="config-reloader"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485439    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="config-reloader"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485445    6048 cpu_manager.go:414] "containerMap: removing container" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="prometheus"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485450    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="prometheus"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485458    6048 cpu_manager.go:414] "containerMap: removing container" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="thanos-sidecar"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485462    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="thanos-sidecar"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485509    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="init-config-reloader"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485517    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="config-reloader"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485523    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="prometheus"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485529    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="thanos-sidecar"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485535    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="kube-rbac-proxy-thanos"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485540    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="kube-rbac-proxy-web"
Oct 30 20:40:09.485602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.485547    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" containerName="kube-rbac-proxy"
Oct 30 20:40:09.489708 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.489687    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.496775 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.496753    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 20:40:09.496775 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.496753    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 20:40:09.497123 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.496809    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rwtrp\""
Oct 30 20:40:09.497123 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.497113    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 20:40:09.497508 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.497410    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 20:40:09.497508 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.497438    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 20:40:09.497748 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.497568    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 20:40:09.497748 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.497586    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 20:40:09.497748 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.497626    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 20:40:09.497748 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.497673    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 20:40:09.497748 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.497683    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-31m0mj31dkhmr\""
Oct 30 20:40:09.509925 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.509909    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 20:40:09.513319 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.513301    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 20:40:09.513877 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.513856    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 20:40:09.516364 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.516347    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 20:40:09.516532 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.516514    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 20:40:09.518280 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.518259    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 20:40:09.625788 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.625752    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.625792    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.625825    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-config\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.625859    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.625937    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.625956    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.625982    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.625999    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626246 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.626090    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626246 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.626109    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626246 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.626125    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626246 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.626148    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626246 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.626167    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626246 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.626231    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626417 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.626313    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626417 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.626355    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626417 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.626400    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626506 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.626421    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626506 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.626451    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.626506 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.626486    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72hws\" (UniqueName: \"kubernetes.io/projected/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-kube-api-access-72hws\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.727492 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727419    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.727492 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727459    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.727492 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727479    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.727713 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727504    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.727713 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727533    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.727713 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727558    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72hws\" (UniqueName: \"kubernetes.io/projected/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-kube-api-access-72hws\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.727713 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727587    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.727713 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727618    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.727713 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727659    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-config\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.727713 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727683    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.727713 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727714    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.728064 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727737    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.728064 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727764    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.728064 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727787    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.728064 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727809    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.728064 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727836    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.728064 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727857    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.728064 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727882    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.728064 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727906    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.728064 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.727938    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.728469 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.728304    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.729250 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.728902    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.729250 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.729207    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.729446 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.729277    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.731535 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.731404    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.731535 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.731412    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.731698 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.731590    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.731698 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.731686    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.731871 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.731848    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.732086 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.732065    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.732242 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.732226    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.732312 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.732273    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.732832 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.732811    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.732983 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.732963    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.733308 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.733287    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.733308 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.733300    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.733461 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.733302    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.733461 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.733370    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-config\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.734313 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.734295    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.740186 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.740162    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72hws\" (UniqueName: \"kubernetes.io/projected/22efd4ff-977d-42a3-843a-f0f4a5acb4e6-kube-api-access-72hws\") pod \"prometheus-k8s-0\" (UID: \"22efd4ff-977d-42a3-843a-f0f4a5acb4e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:09.809183 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:09.809159    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:10.094139 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:10.094104    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 20:40:10.096905 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:40:10.096879    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22efd4ff_977d_42a3_843a_f0f4a5acb4e6.slice/crio-d30ece6f9f0263d2af5c79b1f36845499b06d79aa0dfb7f5780efc28ba6380eb WatchSource:0}: Error finding container d30ece6f9f0263d2af5c79b1f36845499b06d79aa0dfb7f5780efc28ba6380eb: Status 404 returned error can't find the container with id d30ece6f9f0263d2af5c79b1f36845499b06d79aa0dfb7f5780efc28ba6380eb
Oct 30 20:40:10.424669 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:10.424565    6048 generic.go:356] "Generic (PLEG): container finished" podID="22efd4ff-977d-42a3-843a-f0f4a5acb4e6" containerID="2d21bbb200631f6954d08204dbbb64df4c1ebcfc0717cb5d6a37bc3db5770db3" exitCode=0
Oct 30 20:40:10.425173 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:10.424662    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22efd4ff-977d-42a3-843a-f0f4a5acb4e6","Type":"ContainerDied","Data":"2d21bbb200631f6954d08204dbbb64df4c1ebcfc0717cb5d6a37bc3db5770db3"}
Oct 30 20:40:10.425173 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:10.424761    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22efd4ff-977d-42a3-843a-f0f4a5acb4e6","Type":"ContainerStarted","Data":"d30ece6f9f0263d2af5c79b1f36845499b06d79aa0dfb7f5780efc28ba6380eb"}
Oct 30 20:40:11.256489 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:11.256454    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92816bb4-0182-459b-984a-cfebd04c7f20" path="/var/lib/kubelet/pods/92816bb4-0182-459b-984a-cfebd04c7f20/volumes"
Oct 30 20:40:11.432772 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:11.432741    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22efd4ff-977d-42a3-843a-f0f4a5acb4e6","Type":"ContainerStarted","Data":"b18fd38415e8541fdd154cb15dccca5d3ff256de3b7cb7ae4ade02b2c99e7047"}
Oct 30 20:40:11.433174 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:11.432802    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22efd4ff-977d-42a3-843a-f0f4a5acb4e6","Type":"ContainerStarted","Data":"e1cd990497dfd9848532a9a1c1f23f2f7c43bd1c147b4e9781fea8e710871e3a"}
Oct 30 20:40:11.433174 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:11.432830    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22efd4ff-977d-42a3-843a-f0f4a5acb4e6","Type":"ContainerStarted","Data":"7bee1010ce30c268a5aaba320de207efc665b3efe277cdb913669fc978f901e2"}
Oct 30 20:40:11.433174 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:11.432855    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22efd4ff-977d-42a3-843a-f0f4a5acb4e6","Type":"ContainerStarted","Data":"1bd54bf7ce9740461e0747dda2a559f85bc94647e52dee974bad875fc77f90a5"}
Oct 30 20:40:11.433174 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:11.432879    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22efd4ff-977d-42a3-843a-f0f4a5acb4e6","Type":"ContainerStarted","Data":"efe4868bb9864735c96468f0d540d6bc244892d8a9e89c72edb38a7b643fe5a5"}
Oct 30 20:40:11.433174 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:11.432902    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22efd4ff-977d-42a3-843a-f0f4a5acb4e6","Type":"ContainerStarted","Data":"102d0a85870d216afe5a66ba5d5f89f9168e058ac4c344a643576eb33a52e297"}
Oct 30 20:40:11.470578 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:11.470531    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.453831634 podStartE2EDuration="2.470516372s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.684738ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:40:11.468992519 +0000 UTC m=+22.327728846" watchObservedRunningTime="2026-10-30 20:40:11.470516372 +0000 UTC m=+22.329252667"
Oct 30 20:40:14.809735 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:14.809686    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:16.799120 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:16.799087    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:40:19.616556 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:19.616526    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjpxk"
Oct 30 20:40:25.693287 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:25.693256    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g5cnl"
Oct 30 20:40:46.799894 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:40:46.799845    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:40:57.915358 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:57.915316    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:57.930909 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:57.930886    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:40:58.645950 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:40:58.645924    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:41:16.799545 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:41:16.799508    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:41:46.799611 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:41:46.799514    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:42:16.799505 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:42:16.799464    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:42:30.027854 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.027823    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"]
Oct 30 20:42:30.031142 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.031125    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.077920 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.077887    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"]
Oct 30 20:42:30.089199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.089152    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 20:42:30.089323 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.089303    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 20:42:30.090538 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.090494    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-hvr5z\""
Oct 30 20:42:30.090538 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.090524    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 20:42:30.090716 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.090574    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 20:42:30.090716 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.090639    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 20:42:30.132585 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.132562    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/239248e2-6893-454d-b6ae-8cce8b00763d-tmp\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.132711 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.132610    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/239248e2-6893-454d-b6ae-8cce8b00763d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.132711 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.132689    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/239248e2-6893-454d-b6ae-8cce8b00763d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.132822 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.132802    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbsv4\" (UniqueName: \"kubernetes.io/projected/239248e2-6893-454d-b6ae-8cce8b00763d-kube-api-access-nbsv4\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.132873 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.132836    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/239248e2-6893-454d-b6ae-8cce8b00763d-manifests\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.132956 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.132938    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/239248e2-6893-454d-b6ae-8cce8b00763d-metrics-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.234218 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.234180    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbsv4\" (UniqueName: \"kubernetes.io/projected/239248e2-6893-454d-b6ae-8cce8b00763d-kube-api-access-nbsv4\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.234418 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.234237    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/239248e2-6893-454d-b6ae-8cce8b00763d-manifests\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.234418 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.234293    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/239248e2-6893-454d-b6ae-8cce8b00763d-metrics-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.234418 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.234318    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/239248e2-6893-454d-b6ae-8cce8b00763d-tmp\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.234418 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.234385    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/239248e2-6893-454d-b6ae-8cce8b00763d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.234630 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.234419    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/239248e2-6893-454d-b6ae-8cce8b00763d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.234681 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.234669    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/239248e2-6893-454d-b6ae-8cce8b00763d-manifests\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.236722 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.236696    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/239248e2-6893-454d-b6ae-8cce8b00763d-tmp\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.236900 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.236882    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/239248e2-6893-454d-b6ae-8cce8b00763d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.237067 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.237045    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/239248e2-6893-454d-b6ae-8cce8b00763d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.237110 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.237055    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/239248e2-6893-454d-b6ae-8cce8b00763d-metrics-cert\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.247497 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.247470    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbsv4\" (UniqueName: \"kubernetes.io/projected/239248e2-6893-454d-b6ae-8cce8b00763d-kube-api-access-nbsv4\") pod \"opendatahub-operator-controller-manager-5d46577d6f-8b72x\" (UID: \"239248e2-6893-454d-b6ae-8cce8b00763d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.346396 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.346365    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:30.651442 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.651330    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"]
Oct 30 20:42:30.653858 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:42:30.653832    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239248e2_6893_454d_b6ae_8cce8b00763d.slice/crio-9c035d7df936781cee339d113b1babe68b921db00efe1d3a009f1c84f0950842 WatchSource:0}: Error finding container 9c035d7df936781cee339d113b1babe68b921db00efe1d3a009f1c84f0950842: Status 404 returned error can't find the container with id 9c035d7df936781cee339d113b1babe68b921db00efe1d3a009f1c84f0950842
Oct 30 20:42:30.660114 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.656129    6048 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:42:30.977351 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:30.977264    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x" event={"ID":"239248e2-6893-454d-b6ae-8cce8b00763d","Type":"ContainerStarted","Data":"9c035d7df936781cee339d113b1babe68b921db00efe1d3a009f1c84f0950842"}
Oct 30 20:42:33.991323 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:33.991283    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x" event={"ID":"239248e2-6893-454d-b6ae-8cce8b00763d","Type":"ContainerStarted","Data":"1442b7e43b004d2f1bb49065be43436d2230402b962352df036eb9fae76d7607"}
Oct 30 20:42:34.997638 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:34.997599    6048 generic.go:356] "Generic (PLEG): container finished" podID="239248e2-6893-454d-b6ae-8cce8b00763d" containerID="1442b7e43b004d2f1bb49065be43436d2230402b962352df036eb9fae76d7607" exitCode=0
Oct 30 20:42:34.998040 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:34.997659    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x" event={"ID":"239248e2-6893-454d-b6ae-8cce8b00763d","Type":"ContainerDied","Data":"1442b7e43b004d2f1bb49065be43436d2230402b962352df036eb9fae76d7607"}
Oct 30 20:42:36.002839 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:36.002803    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x" event={"ID":"239248e2-6893-454d-b6ae-8cce8b00763d","Type":"ContainerStarted","Data":"dff7873d76125b02a6df7b147a9973dcf78c6c01785b0f5a4bc3061b0f56a0bd"}
Oct 30 20:42:36.003263 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:36.002896    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:36.053169 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:36.053120    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x" podStartSLOduration=3.317159833 podStartE2EDuration="7.053104062s" totalImagesPullingTime="3.264640998s" totalInitContainerRuntime="471.303231ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:42:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:42:36.05149253 +0000 UTC m=+166.910228824" watchObservedRunningTime="2026-10-30 20:42:36.053104062 +0000 UTC m=+166.911840346"
Oct 30 20:42:39.190239 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.190199    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw"]
Oct 30 20:42:39.196499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.196471    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw"
Oct 30 20:42:39.203604 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.203585    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 30 20:42:39.203604 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.203590    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:42:39.217745 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.217722    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-jqxt6\""
Oct 30 20:42:39.217947 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.217931    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw"]
Oct 30 20:42:39.221263 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.221242    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b97rh\" (UniqueName: \"kubernetes.io/projected/88552c39-f7f3-4bdc-be24-18fd0583312b-kube-api-access-b97rh\") pod \"jobset-operator-674cd59dc5-6lwvw\" (UID: \"88552c39-f7f3-4bdc-be24-18fd0583312b\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw"
Oct 30 20:42:39.221354 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.221292    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88552c39-f7f3-4bdc-be24-18fd0583312b-tmp\") pod \"jobset-operator-674cd59dc5-6lwvw\" (UID: \"88552c39-f7f3-4bdc-be24-18fd0583312b\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw"
Oct 30 20:42:39.322398 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.322364    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88552c39-f7f3-4bdc-be24-18fd0583312b-tmp\") pod \"jobset-operator-674cd59dc5-6lwvw\" (UID: \"88552c39-f7f3-4bdc-be24-18fd0583312b\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw"
Oct 30 20:42:39.322575 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.322435    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b97rh\" (UniqueName: \"kubernetes.io/projected/88552c39-f7f3-4bdc-be24-18fd0583312b-kube-api-access-b97rh\") pod \"jobset-operator-674cd59dc5-6lwvw\" (UID: \"88552c39-f7f3-4bdc-be24-18fd0583312b\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw"
Oct 30 20:42:39.322778 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.322758    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88552c39-f7f3-4bdc-be24-18fd0583312b-tmp\") pod \"jobset-operator-674cd59dc5-6lwvw\" (UID: \"88552c39-f7f3-4bdc-be24-18fd0583312b\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw"
Oct 30 20:42:39.336470 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.336448    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b97rh\" (UniqueName: \"kubernetes.io/projected/88552c39-f7f3-4bdc-be24-18fd0583312b-kube-api-access-b97rh\") pod \"jobset-operator-674cd59dc5-6lwvw\" (UID: \"88552c39-f7f3-4bdc-be24-18fd0583312b\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw"
Oct 30 20:42:39.519826 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.519738    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw"
Oct 30 20:42:39.852164 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:42:39.852137    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88552c39_f7f3_4bdc_be24_18fd0583312b.slice/crio-db75c6f1cb583f6d2cbf3b1725486cbe79d37f598aad6a33a60b1cb07a1c1045 WatchSource:0}: Error finding container db75c6f1cb583f6d2cbf3b1725486cbe79d37f598aad6a33a60b1cb07a1c1045: Status 404 returned error can't find the container with id db75c6f1cb583f6d2cbf3b1725486cbe79d37f598aad6a33a60b1cb07a1c1045
Oct 30 20:42:39.852302 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:39.852267    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw"]
Oct 30 20:42:40.019254 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:40.019220    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw" event={"ID":"88552c39-f7f3-4bdc-be24-18fd0583312b","Type":"ContainerStarted","Data":"db75c6f1cb583f6d2cbf3b1725486cbe79d37f598aad6a33a60b1cb07a1c1045"}
Oct 30 20:42:43.034513 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:43.034469    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw" event={"ID":"88552c39-f7f3-4bdc-be24-18fd0583312b","Type":"ContainerStarted","Data":"8246eee7816c7feb5a060335d346e6ab635c655e377489e2e3da347708b48cb1"}
Oct 30 20:42:46.799855 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:42:46.799820    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:42:47.009165 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:47.009134    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5d46577d6f-8b72x"
Oct 30 20:42:47.083681 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:47.083626    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-6lwvw" podStartSLOduration=5.070785365 podStartE2EDuration="8.083608354s" totalImagesPullingTime="3.012822989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:42:43.05754666 +0000 UTC m=+173.916282958" watchObservedRunningTime="2026-10-30 20:42:47.083608354 +0000 UTC m=+177.942344645"
Oct 30 20:42:49.397863 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.397831    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"]
Oct 30 20:42:49.402717 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.402696    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"
Oct 30 20:42:49.409896 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.409874    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-plzt7\""
Oct 30 20:42:49.410004 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.409934    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"]
Oct 30 20:42:49.418920 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.418901    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 20:42:49.419223 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.419207    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 20:42:49.515207 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.515173    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd2d2\" (UniqueName: \"kubernetes.io/projected/b29902e9-0a2b-4612-827f-5e2096f24d77-kube-api-access-nd2d2\") pod \"cert-manager-webhook-5dbbbf75cc-sftb7\" (UID: \"b29902e9-0a2b-4612-827f-5e2096f24d77\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"
Oct 30 20:42:49.515364 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.515231    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b29902e9-0a2b-4612-827f-5e2096f24d77-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-sftb7\" (UID: \"b29902e9-0a2b-4612-827f-5e2096f24d77\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"
Oct 30 20:42:49.616434 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.616400    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b29902e9-0a2b-4612-827f-5e2096f24d77-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-sftb7\" (UID: \"b29902e9-0a2b-4612-827f-5e2096f24d77\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"
Oct 30 20:42:49.616590 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.616469    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2d2\" (UniqueName: \"kubernetes.io/projected/b29902e9-0a2b-4612-827f-5e2096f24d77-kube-api-access-nd2d2\") pod \"cert-manager-webhook-5dbbbf75cc-sftb7\" (UID: \"b29902e9-0a2b-4612-827f-5e2096f24d77\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"
Oct 30 20:42:49.639515 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.639487    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b29902e9-0a2b-4612-827f-5e2096f24d77-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-sftb7\" (UID: \"b29902e9-0a2b-4612-827f-5e2096f24d77\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"
Oct 30 20:42:49.639628 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.639488    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd2d2\" (UniqueName: \"kubernetes.io/projected/b29902e9-0a2b-4612-827f-5e2096f24d77-kube-api-access-nd2d2\") pod \"cert-manager-webhook-5dbbbf75cc-sftb7\" (UID: \"b29902e9-0a2b-4612-827f-5e2096f24d77\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"
Oct 30 20:42:49.717010 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.716942    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"
Oct 30 20:42:49.994754 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:49.994557    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"]
Oct 30 20:42:49.997627 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:42:49.997595    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb29902e9_0a2b_4612_827f_5e2096f24d77.slice/crio-2b24d96e3be0294478f12f95f3b7381c0f9c6c5379b2c74b310d3f94fba15cd3 WatchSource:0}: Error finding container 2b24d96e3be0294478f12f95f3b7381c0f9c6c5379b2c74b310d3f94fba15cd3: Status 404 returned error can't find the container with id 2b24d96e3be0294478f12f95f3b7381c0f9c6c5379b2c74b310d3f94fba15cd3
Oct 30 20:42:50.066826 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:50.066792    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7" event={"ID":"b29902e9-0a2b-4612-827f-5e2096f24d77","Type":"ContainerStarted","Data":"2b24d96e3be0294478f12f95f3b7381c0f9c6c5379b2c74b310d3f94fba15cd3"}
Oct 30 20:42:54.085487 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.085447    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7" event={"ID":"b29902e9-0a2b-4612-827f-5e2096f24d77","Type":"ContainerStarted","Data":"dba52d1ab03095356ed348f0096fc281f2b67e186b5cfbb7d79dc013994c1762"}
Oct 30 20:42:54.085924 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.085561    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"
Oct 30 20:42:54.303986 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.303926    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7" podStartSLOduration=1.7652521669999999 podStartE2EDuration="5.303910964s" totalImagesPullingTime="3.538658797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:42:54.110380056 +0000 UTC m=+184.969116350" watchObservedRunningTime="2026-10-30 20:42:54.303910964 +0000 UTC m=+185.162647257"
Oct 30 20:42:54.304201 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.304094    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-jj7gh"]
Oct 30 20:42:54.307566 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.307543    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-jj7gh"
Oct 30 20:42:54.318167 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.318146    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xzz27\""
Oct 30 20:42:54.357134 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.357075    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-jj7gh"]
Oct 30 20:42:54.362537 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.362515    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94k5q\" (UniqueName: \"kubernetes.io/projected/07f872ff-9813-4707-a002-0843d48c20e0-kube-api-access-94k5q\") pod \"cert-manager-597b95cb84-jj7gh\" (UID: \"07f872ff-9813-4707-a002-0843d48c20e0\") " pod="cert-manager/cert-manager-597b95cb84-jj7gh"
Oct 30 20:42:54.362647 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.362574    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07f872ff-9813-4707-a002-0843d48c20e0-bound-sa-token\") pod \"cert-manager-597b95cb84-jj7gh\" (UID: \"07f872ff-9813-4707-a002-0843d48c20e0\") " pod="cert-manager/cert-manager-597b95cb84-jj7gh"
Oct 30 20:42:54.463205 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.463169    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94k5q\" (UniqueName: \"kubernetes.io/projected/07f872ff-9813-4707-a002-0843d48c20e0-kube-api-access-94k5q\") pod \"cert-manager-597b95cb84-jj7gh\" (UID: \"07f872ff-9813-4707-a002-0843d48c20e0\") " pod="cert-manager/cert-manager-597b95cb84-jj7gh"
Oct 30 20:42:54.463379 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.463233    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07f872ff-9813-4707-a002-0843d48c20e0-bound-sa-token\") pod \"cert-manager-597b95cb84-jj7gh\" (UID: \"07f872ff-9813-4707-a002-0843d48c20e0\") " pod="cert-manager/cert-manager-597b95cb84-jj7gh"
Oct 30 20:42:54.479663 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.479635    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94k5q\" (UniqueName: \"kubernetes.io/projected/07f872ff-9813-4707-a002-0843d48c20e0-kube-api-access-94k5q\") pod \"cert-manager-597b95cb84-jj7gh\" (UID: \"07f872ff-9813-4707-a002-0843d48c20e0\") " pod="cert-manager/cert-manager-597b95cb84-jj7gh"
Oct 30 20:42:54.483146 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.483122    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07f872ff-9813-4707-a002-0843d48c20e0-bound-sa-token\") pod \"cert-manager-597b95cb84-jj7gh\" (UID: \"07f872ff-9813-4707-a002-0843d48c20e0\") " pod="cert-manager/cert-manager-597b95cb84-jj7gh"
Oct 30 20:42:54.619247 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.619159    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-jj7gh"
Oct 30 20:42:54.925287 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:54.925128    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-jj7gh"]
Oct 30 20:42:54.927915 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:42:54.927887    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07f872ff_9813_4707_a002_0843d48c20e0.slice/crio-255f8d9a2239e464424b760a916e03ff3adb9b53c3f54cb916d3fdb1937bf668 WatchSource:0}: Error finding container 255f8d9a2239e464424b760a916e03ff3adb9b53c3f54cb916d3fdb1937bf668: Status 404 returned error can't find the container with id 255f8d9a2239e464424b760a916e03ff3adb9b53c3f54cb916d3fdb1937bf668
Oct 30 20:42:55.090712 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:55.090676    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-jj7gh" event={"ID":"07f872ff-9813-4707-a002-0843d48c20e0","Type":"ContainerStarted","Data":"002267f2356a6c387af6a69fde300744ac22c61d52790c5a0e0e6453ad074bf2"}
Oct 30 20:42:55.090712 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:55.090722    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-jj7gh" event={"ID":"07f872ff-9813-4707-a002-0843d48c20e0","Type":"ContainerStarted","Data":"255f8d9a2239e464424b760a916e03ff3adb9b53c3f54cb916d3fdb1937bf668"}
Oct 30 20:42:55.113213 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:42:55.113163    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-jj7gh" podStartSLOduration=1.113147736 podStartE2EDuration="1.113147736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:42:55.11251224 +0000 UTC m=+185.971248533" watchObservedRunningTime="2026-10-30 20:42:55.113147736 +0000 UTC m=+185.971884029"
Oct 30 20:43:00.092699 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:00.092628    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-sftb7"
Oct 30 20:43:05.424199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.424166    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"]
Oct 30 20:43:05.427623 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.427605    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"
Oct 30 20:43:05.435511 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.435477    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 20:43:05.437136 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.437108    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 20:43:05.437136 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.437117    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Oct 30 20:43:05.437442 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.437424    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qj27b\""
Oct 30 20:43:05.437538 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.437503    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Oct 30 20:43:05.439860 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.439840    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"]
Oct 30 20:43:05.575075 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.575040    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff31bc45-f214-4fe4-a0b6-f22c60d6d998-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-jdtlr\" (UID: \"ff31bc45-f214-4fe4-a0b6-f22c60d6d998\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"
Oct 30 20:43:05.575240 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.575088    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnsj9\" (UniqueName: \"kubernetes.io/projected/ff31bc45-f214-4fe4-a0b6-f22c60d6d998-kube-api-access-mnsj9\") pod \"kuadrant-console-plugin-66c4fb575d-jdtlr\" (UID: \"ff31bc45-f214-4fe4-a0b6-f22c60d6d998\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"
Oct 30 20:43:05.575240 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.575151    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff31bc45-f214-4fe4-a0b6-f22c60d6d998-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-jdtlr\" (UID: \"ff31bc45-f214-4fe4-a0b6-f22c60d6d998\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"
Oct 30 20:43:05.676421 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.676345    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff31bc45-f214-4fe4-a0b6-f22c60d6d998-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-jdtlr\" (UID: \"ff31bc45-f214-4fe4-a0b6-f22c60d6d998\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"
Oct 30 20:43:05.676421 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.676381    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnsj9\" (UniqueName: \"kubernetes.io/projected/ff31bc45-f214-4fe4-a0b6-f22c60d6d998-kube-api-access-mnsj9\") pod \"kuadrant-console-plugin-66c4fb575d-jdtlr\" (UID: \"ff31bc45-f214-4fe4-a0b6-f22c60d6d998\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"
Oct 30 20:43:05.676421 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.676401    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff31bc45-f214-4fe4-a0b6-f22c60d6d998-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-jdtlr\" (UID: \"ff31bc45-f214-4fe4-a0b6-f22c60d6d998\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"
Oct 30 20:43:05.677091 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.677063    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff31bc45-f214-4fe4-a0b6-f22c60d6d998-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-jdtlr\" (UID: \"ff31bc45-f214-4fe4-a0b6-f22c60d6d998\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"
Oct 30 20:43:05.678809 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.678790    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff31bc45-f214-4fe4-a0b6-f22c60d6d998-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-jdtlr\" (UID: \"ff31bc45-f214-4fe4-a0b6-f22c60d6d998\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"
Oct 30 20:43:05.689635 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.689609    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnsj9\" (UniqueName: \"kubernetes.io/projected/ff31bc45-f214-4fe4-a0b6-f22c60d6d998-kube-api-access-mnsj9\") pod \"kuadrant-console-plugin-66c4fb575d-jdtlr\" (UID: \"ff31bc45-f214-4fe4-a0b6-f22c60d6d998\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"
Oct 30 20:43:05.741356 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:05.741329    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"
Oct 30 20:43:06.014488 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.014412    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr"]
Oct 30 20:43:06.018242 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:43:06.018212    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff31bc45_f214_4fe4_a0b6_f22c60d6d998.slice/crio-369742e6791e453422b60c55c9d77868da6160bf774ee2bb170c59923f9229a3 WatchSource:0}: Error finding container 369742e6791e453422b60c55c9d77868da6160bf774ee2bb170c59923f9229a3: Status 404 returned error can't find the container with id 369742e6791e453422b60c55c9d77868da6160bf774ee2bb170c59923f9229a3
Oct 30 20:43:06.137811 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.137776    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr" event={"ID":"ff31bc45-f214-4fe4-a0b6-f22c60d6d998","Type":"ContainerStarted","Data":"369742e6791e453422b60c55c9d77868da6160bf774ee2bb170c59923f9229a3"}
Oct 30 20:43:06.266925 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.266845    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"]
Oct 30 20:43:06.272887 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.272865    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"
Oct 30 20:43:06.295480 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.295445    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 30 20:43:06.295621 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.295546    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zzbjx\""
Oct 30 20:43:06.295621 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.295573    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 30 20:43:06.300396 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.300377    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 20:43:06.300396 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.300387    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 20:43:06.307226 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.307192    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"]
Oct 30 20:43:06.384373 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.384344    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f40ef661-ad7c-4d2d-8af1-01c99b180241-tls-certs\") pod \"kube-auth-proxy-85bbc4c96f-gc4dr\" (UID: \"f40ef661-ad7c-4d2d-8af1-01c99b180241\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"
Oct 30 20:43:06.384528 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.384393    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f40ef661-ad7c-4d2d-8af1-01c99b180241-tmp\") pod \"kube-auth-proxy-85bbc4c96f-gc4dr\" (UID: \"f40ef661-ad7c-4d2d-8af1-01c99b180241\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"
Oct 30 20:43:06.384576 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.384541    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpcc5\" (UniqueName: \"kubernetes.io/projected/f40ef661-ad7c-4d2d-8af1-01c99b180241-kube-api-access-qpcc5\") pod \"kube-auth-proxy-85bbc4c96f-gc4dr\" (UID: \"f40ef661-ad7c-4d2d-8af1-01c99b180241\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"
Oct 30 20:43:06.485802 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.485767    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f40ef661-ad7c-4d2d-8af1-01c99b180241-tls-certs\") pod \"kube-auth-proxy-85bbc4c96f-gc4dr\" (UID: \"f40ef661-ad7c-4d2d-8af1-01c99b180241\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"
Oct 30 20:43:06.486327 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.485821    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f40ef661-ad7c-4d2d-8af1-01c99b180241-tmp\") pod \"kube-auth-proxy-85bbc4c96f-gc4dr\" (UID: \"f40ef661-ad7c-4d2d-8af1-01c99b180241\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"
Oct 30 20:43:06.486327 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.485900    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpcc5\" (UniqueName: \"kubernetes.io/projected/f40ef661-ad7c-4d2d-8af1-01c99b180241-kube-api-access-qpcc5\") pod \"kube-auth-proxy-85bbc4c96f-gc4dr\" (UID: \"f40ef661-ad7c-4d2d-8af1-01c99b180241\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"
Oct 30 20:43:06.488292 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.488254    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f40ef661-ad7c-4d2d-8af1-01c99b180241-tmp\") pod \"kube-auth-proxy-85bbc4c96f-gc4dr\" (UID: \"f40ef661-ad7c-4d2d-8af1-01c99b180241\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"
Oct 30 20:43:06.488493 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.488473    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f40ef661-ad7c-4d2d-8af1-01c99b180241-tls-certs\") pod \"kube-auth-proxy-85bbc4c96f-gc4dr\" (UID: \"f40ef661-ad7c-4d2d-8af1-01c99b180241\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"
Oct 30 20:43:06.547269 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.547202    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpcc5\" (UniqueName: \"kubernetes.io/projected/f40ef661-ad7c-4d2d-8af1-01c99b180241-kube-api-access-qpcc5\") pod \"kube-auth-proxy-85bbc4c96f-gc4dr\" (UID: \"f40ef661-ad7c-4d2d-8af1-01c99b180241\") " pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"
Oct 30 20:43:06.586876 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.586843    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"
Oct 30 20:43:06.876211 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:06.876176    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr"]
Oct 30 20:43:06.880714 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:43:06.880684    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40ef661_ad7c_4d2d_8af1_01c99b180241.slice/crio-b634c807c2e034d3e25c6a3b6f4e2015745c4161d9dd8c1dc394d960b9b2eb28 WatchSource:0}: Error finding container b634c807c2e034d3e25c6a3b6f4e2015745c4161d9dd8c1dc394d960b9b2eb28: Status 404 returned error can't find the container with id b634c807c2e034d3e25c6a3b6f4e2015745c4161d9dd8c1dc394d960b9b2eb28
Oct 30 20:43:07.148204 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:07.148117    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr" event={"ID":"f40ef661-ad7c-4d2d-8af1-01c99b180241","Type":"ContainerStarted","Data":"b634c807c2e034d3e25c6a3b6f4e2015745c4161d9dd8c1dc394d960b9b2eb28"}
Oct 30 20:43:10.165612 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:10.165574    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr" event={"ID":"f40ef661-ad7c-4d2d-8af1-01c99b180241","Type":"ContainerStarted","Data":"89b59071ede0418095e2432235f2235fe42cdd41bba6f28af028c915bfa90dab"}
Oct 30 20:43:10.192064 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:10.191959    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85bbc4c96f-gc4dr" podStartSLOduration=1.489198759 podStartE2EDuration="4.191913072s" totalImagesPullingTime="2.702714313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:10.191068352 +0000 UTC m=+201.049804646" watchObservedRunningTime="2026-10-30 20:43:10.191913072 +0000 UTC m=+201.050649365"
Oct 30 20:43:11.171411 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:11.171365    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr" event={"ID":"ff31bc45-f214-4fe4-a0b6-f22c60d6d998","Type":"ContainerStarted","Data":"4227b91d835af8b0e65482eb64dc119557d6411408b3ab2f05c9171629531d8f"}
Oct 30 20:43:11.198296 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:43:11.198248    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-jdtlr" podStartSLOduration=1.214823191 podStartE2EDuration="6.198234145s" totalImagesPullingTime="4.983410954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:11.197212085 +0000 UTC m=+202.055948379" watchObservedRunningTime="2026-10-30 20:43:11.198234145 +0000 UTC m=+202.056970437"
Oct 30 20:43:16.799540 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:43:16.799501    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:43:46.800067 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:43:46.800012    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:44:04.379188 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.379139    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-s4pwv"]
Oct 30 20:44:04.382691 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.382672    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv"
Oct 30 20:44:04.396419 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.396365    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 20:44:04.396601 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.396560    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 20:44:04.399055 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.399015    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-s4pwv"]
Oct 30 20:44:04.409843 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.409821    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 30 20:44:04.409843 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.409831    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6dvlq\""
Oct 30 20:44:04.489682 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.489646    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/295bb9fe-d414-4890-bc55-057f3fda2428-cert\") pod \"kserve-controller-manager-776cc66d47-s4pwv\" (UID: \"295bb9fe-d414-4890-bc55-057f3fda2428\") " pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv"
Oct 30 20:44:04.489852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.489690    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5d8m\" (UniqueName: \"kubernetes.io/projected/295bb9fe-d414-4890-bc55-057f3fda2428-kube-api-access-w5d8m\") pod \"kserve-controller-manager-776cc66d47-s4pwv\" (UID: \"295bb9fe-d414-4890-bc55-057f3fda2428\") " pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv"
Oct 30 20:44:04.591250 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.591214    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/295bb9fe-d414-4890-bc55-057f3fda2428-cert\") pod \"kserve-controller-manager-776cc66d47-s4pwv\" (UID: \"295bb9fe-d414-4890-bc55-057f3fda2428\") " pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv"
Oct 30 20:44:04.591434 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.591259    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5d8m\" (UniqueName: \"kubernetes.io/projected/295bb9fe-d414-4890-bc55-057f3fda2428-kube-api-access-w5d8m\") pod \"kserve-controller-manager-776cc66d47-s4pwv\" (UID: \"295bb9fe-d414-4890-bc55-057f3fda2428\") " pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv"
Oct 30 20:44:04.593627 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.593604    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/295bb9fe-d414-4890-bc55-057f3fda2428-cert\") pod \"kserve-controller-manager-776cc66d47-s4pwv\" (UID: \"295bb9fe-d414-4890-bc55-057f3fda2428\") " pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv"
Oct 30 20:44:04.607327 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.607306    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5d8m\" (UniqueName: \"kubernetes.io/projected/295bb9fe-d414-4890-bc55-057f3fda2428-kube-api-access-w5d8m\") pod \"kserve-controller-manager-776cc66d47-s4pwv\" (UID: \"295bb9fe-d414-4890-bc55-057f3fda2428\") " pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv"
Oct 30 20:44:04.695179 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.695120    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv"
Oct 30 20:44:04.984765 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:04.984676    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-s4pwv"]
Oct 30 20:44:04.992290 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:44:04.992259    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295bb9fe_d414_4890_bc55_057f3fda2428.slice/crio-2abe327cd9b5dd308a82ad89d729b87802a1c7aa0a80caf70d1fa17474a9274b WatchSource:0}: Error finding container 2abe327cd9b5dd308a82ad89d729b87802a1c7aa0a80caf70d1fa17474a9274b: Status 404 returned error can't find the container with id 2abe327cd9b5dd308a82ad89d729b87802a1c7aa0a80caf70d1fa17474a9274b
Oct 30 20:44:05.403374 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:05.403339    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv" event={"ID":"295bb9fe-d414-4890-bc55-057f3fda2428","Type":"ContainerStarted","Data":"2abe327cd9b5dd308a82ad89d729b87802a1c7aa0a80caf70d1fa17474a9274b"}
Oct 30 20:44:07.414825 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:07.414785    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv" event={"ID":"295bb9fe-d414-4890-bc55-057f3fda2428","Type":"ContainerStarted","Data":"8807a64cf6d9eaa5a785c95e284371fb0e90fddec9b7865360fcd800472a4e99"}
Oct 30 20:44:07.415275 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:07.414916    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv"
Oct 30 20:44:07.434911 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:07.434866    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv" podStartSLOduration=1.659609924 podStartE2EDuration="3.43485209s" totalImagesPullingTime="1.775242166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:07.433792081 +0000 UTC m=+258.292528375" watchObservedRunningTime="2026-10-30 20:44:07.43485209 +0000 UTC m=+258.293588377"
Oct 30 20:44:13.784858 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.784825    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"]
Oct 30 20:44:13.788444 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.788423    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:13.798104 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.798084    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Oct 30 20:44:13.799163 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.799141    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-zckvg\""
Oct 30 20:44:13.799273 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.799151    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Oct 30 20:44:13.799329 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.799269    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Oct 30 20:44:13.800265 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.800244    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"]
Oct 30 20:44:13.877590 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.877552    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fec53476-14d9-4d44-85b4-09582a1d8256-cert\") pod \"jobset-controller-manager-5588c9b996-gb4sz\" (UID: \"fec53476-14d9-4d44-85b4-09582a1d8256\") " pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:13.877749 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.877609    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wjfw\" (UniqueName: \"kubernetes.io/projected/fec53476-14d9-4d44-85b4-09582a1d8256-kube-api-access-7wjfw\") pod \"jobset-controller-manager-5588c9b996-gb4sz\" (UID: \"fec53476-14d9-4d44-85b4-09582a1d8256\") " pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:13.877749 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.877691    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fec53476-14d9-4d44-85b4-09582a1d8256-manager-config\") pod \"jobset-controller-manager-5588c9b996-gb4sz\" (UID: \"fec53476-14d9-4d44-85b4-09582a1d8256\") " pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:13.877828 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.877750    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec53476-14d9-4d44-85b4-09582a1d8256-metrics-certs\") pod \"jobset-controller-manager-5588c9b996-gb4sz\" (UID: \"fec53476-14d9-4d44-85b4-09582a1d8256\") " pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:13.978215 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.978184    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fec53476-14d9-4d44-85b4-09582a1d8256-manager-config\") pod \"jobset-controller-manager-5588c9b996-gb4sz\" (UID: \"fec53476-14d9-4d44-85b4-09582a1d8256\") " pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:13.978382 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.978244    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec53476-14d9-4d44-85b4-09582a1d8256-metrics-certs\") pod \"jobset-controller-manager-5588c9b996-gb4sz\" (UID: \"fec53476-14d9-4d44-85b4-09582a1d8256\") " pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:13.978382 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.978293    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fec53476-14d9-4d44-85b4-09582a1d8256-cert\") pod \"jobset-controller-manager-5588c9b996-gb4sz\" (UID: \"fec53476-14d9-4d44-85b4-09582a1d8256\") " pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:13.978382 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.978336    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wjfw\" (UniqueName: \"kubernetes.io/projected/fec53476-14d9-4d44-85b4-09582a1d8256-kube-api-access-7wjfw\") pod \"jobset-controller-manager-5588c9b996-gb4sz\" (UID: \"fec53476-14d9-4d44-85b4-09582a1d8256\") " pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:13.979006 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.978979    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fec53476-14d9-4d44-85b4-09582a1d8256-manager-config\") pod \"jobset-controller-manager-5588c9b996-gb4sz\" (UID: \"fec53476-14d9-4d44-85b4-09582a1d8256\") " pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:13.980749 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.980726    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fec53476-14d9-4d44-85b4-09582a1d8256-metrics-certs\") pod \"jobset-controller-manager-5588c9b996-gb4sz\" (UID: \"fec53476-14d9-4d44-85b4-09582a1d8256\") " pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:13.980826 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.980779    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fec53476-14d9-4d44-85b4-09582a1d8256-cert\") pod \"jobset-controller-manager-5588c9b996-gb4sz\" (UID: \"fec53476-14d9-4d44-85b4-09582a1d8256\") " pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:13.990702 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:13.990676    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wjfw\" (UniqueName: \"kubernetes.io/projected/fec53476-14d9-4d44-85b4-09582a1d8256-kube-api-access-7wjfw\") pod \"jobset-controller-manager-5588c9b996-gb4sz\" (UID: \"fec53476-14d9-4d44-85b4-09582a1d8256\") " pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:14.099846 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:14.099818    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:14.409636 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:14.409555    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"]
Oct 30 20:44:14.414215 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:44:14.414175    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec53476_14d9_4d44_85b4_09582a1d8256.slice/crio-2dbc25f7454729b82ed100e3a711bd24d423a68dfeb66d10876a50d39c200fa5 WatchSource:0}: Error finding container 2dbc25f7454729b82ed100e3a711bd24d423a68dfeb66d10876a50d39c200fa5: Status 404 returned error can't find the container with id 2dbc25f7454729b82ed100e3a711bd24d423a68dfeb66d10876a50d39c200fa5
Oct 30 20:44:14.449619 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:14.449583    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz" event={"ID":"fec53476-14d9-4d44-85b4-09582a1d8256","Type":"ContainerStarted","Data":"2dbc25f7454729b82ed100e3a711bd24d423a68dfeb66d10876a50d39c200fa5"}
Oct 30 20:44:16.806536 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:44:16.806495    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:44:18.479203 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:18.479165    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz" event={"ID":"fec53476-14d9-4d44-85b4-09582a1d8256","Type":"ContainerStarted","Data":"836b9dfb8ead44e6072e0c1c28477ef6bf9aa265daea3077c165f877b5a34097"}
Oct 30 20:44:18.479635 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:18.479281    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:18.499460 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:18.499413    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz" podStartSLOduration=2.250195322 podStartE2EDuration="5.499401425s" totalImagesPullingTime="3.249206103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:18.498519004 +0000 UTC m=+269.357255298" watchObservedRunningTime="2026-10-30 20:44:18.499401425 +0000 UTC m=+269.358137782"
Oct 30 20:44:29.489402 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:29.489373    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-5588c9b996-gb4sz"
Oct 30 20:44:38.425604 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:44:38.425521    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-s4pwv"
Oct 30 20:44:46.800133 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:44:46.800091    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:45:16.800012 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:45:16.799966    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:45:46.799797 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:45:46.799757    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:46:16.799810 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:46:16.799717    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:46:46.799787 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:46:46.799743    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:47:16.800073 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:47:16.800037    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:47:46.799614 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:47:46.799527    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:48:16.799913 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:48:16.799874    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:48:46.799431 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:48:46.799387    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:49:16.800892 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:49:16.800809    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:49:46.799440 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:49:46.799405    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:50:16.800652 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:50:16.800608    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:50:46.800219 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:50:46.800140    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:51:16.800083 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:51:16.800047    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:51:46.800357 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:51:46.800322    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:52:16.800549 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:52:16.800474    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:52:46.799621 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:52:46.799584    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:53:16.800154 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:53:16.800118    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:53:45.014337 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:45.014307    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dk86k"]
Oct 30 20:53:45.017734 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:45.017717    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-dk86k"
Oct 30 20:53:45.025359 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:45.025339    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jp6gl\""
Oct 30 20:53:45.029250 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:45.029233    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dk86k"]
Oct 30 20:53:45.126071 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:45.126015    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tcwc\" (UniqueName: \"kubernetes.io/projected/9e9271c2-84d0-435d-833f-4f8ee1a2420d-kube-api-access-9tcwc\") pod \"authorino-56c6c9ddd5-dk86k\" (UID: \"9e9271c2-84d0-435d-833f-4f8ee1a2420d\") " pod="kuadrant-system/authorino-56c6c9ddd5-dk86k"
Oct 30 20:53:45.226744 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:45.226713    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcwc\" (UniqueName: \"kubernetes.io/projected/9e9271c2-84d0-435d-833f-4f8ee1a2420d-kube-api-access-9tcwc\") pod \"authorino-56c6c9ddd5-dk86k\" (UID: \"9e9271c2-84d0-435d-833f-4f8ee1a2420d\") " pod="kuadrant-system/authorino-56c6c9ddd5-dk86k"
Oct 30 20:53:45.240573 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:45.240547    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tcwc\" (UniqueName: \"kubernetes.io/projected/9e9271c2-84d0-435d-833f-4f8ee1a2420d-kube-api-access-9tcwc\") pod \"authorino-56c6c9ddd5-dk86k\" (UID: \"9e9271c2-84d0-435d-833f-4f8ee1a2420d\") " pod="kuadrant-system/authorino-56c6c9ddd5-dk86k"
Oct 30 20:53:45.328902 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:45.328878    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-dk86k"
Oct 30 20:53:45.606076 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:45.605883    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dk86k"]
Oct 30 20:53:45.608919 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:53:45.608890    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e9271c2_84d0_435d_833f_4f8ee1a2420d.slice/crio-13454781d0c233c0ff6a791dd2f743488b12779ca4443ecdd87a817aa1a6a81f WatchSource:0}: Error finding container 13454781d0c233c0ff6a791dd2f743488b12779ca4443ecdd87a817aa1a6a81f: Status 404 returned error can't find the container with id 13454781d0c233c0ff6a791dd2f743488b12779ca4443ecdd87a817aa1a6a81f
Oct 30 20:53:45.610264 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:45.610244    6048 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:53:45.939395 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:45.939313    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-dk86k" event={"ID":"9e9271c2-84d0-435d-833f-4f8ee1a2420d","Type":"ContainerStarted","Data":"13454781d0c233c0ff6a791dd2f743488b12779ca4443ecdd87a817aa1a6a81f"}
Oct 30 20:53:46.807941 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:53:46.807902    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:53:48.955688 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:48.955649    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-dk86k" event={"ID":"9e9271c2-84d0-435d-833f-4f8ee1a2420d","Type":"ContainerStarted","Data":"52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905"}
Oct 30 20:53:48.972718 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:53:48.972657    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-dk86k" podStartSLOduration=2.171584334 podStartE2EDuration="4.972637948s" totalImagesPullingTime="2.801053614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:48.972505496 +0000 UTC m=+839.831241798" watchObservedRunningTime="2026-10-30 20:53:48.972637948 +0000 UTC m=+839.831374241"
Oct 30 20:54:16.801034 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:54:16.800920    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:54:46.800437 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:54:46.800403    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:55:07.137072 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.136974    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-qk8bx"]
Oct 30 20:55:07.140460 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.140432    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-qk8bx"
Oct 30 20:55:07.148827 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.148798    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-qk8bx"]
Oct 30 20:55:07.206222 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.206195    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 30 20:55:07.256845 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.256816    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-tls-cert\") pod \"authorino-6889cbd8c4-qk8bx\" (UID: \"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24\") " pod="kuadrant-system/authorino-6889cbd8c4-qk8bx"
Oct 30 20:55:07.256994 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.256861    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d4vq\" (UniqueName: \"kubernetes.io/projected/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-kube-api-access-5d4vq\") pod \"authorino-6889cbd8c4-qk8bx\" (UID: \"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24\") " pod="kuadrant-system/authorino-6889cbd8c4-qk8bx"
Oct 30 20:55:07.357973 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.357934    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-tls-cert\") pod \"authorino-6889cbd8c4-qk8bx\" (UID: \"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24\") " pod="kuadrant-system/authorino-6889cbd8c4-qk8bx"
Oct 30 20:55:07.358511 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.358045    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d4vq\" (UniqueName: \"kubernetes.io/projected/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-kube-api-access-5d4vq\") pod \"authorino-6889cbd8c4-qk8bx\" (UID: \"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24\") " pod="kuadrant-system/authorino-6889cbd8c4-qk8bx"
Oct 30 20:55:07.360484 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.360464    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-tls-cert\") pod \"authorino-6889cbd8c4-qk8bx\" (UID: \"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24\") " pod="kuadrant-system/authorino-6889cbd8c4-qk8bx"
Oct 30 20:55:07.370800 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.370774    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d4vq\" (UniqueName: \"kubernetes.io/projected/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-kube-api-access-5d4vq\") pod \"authorino-6889cbd8c4-qk8bx\" (UID: \"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24\") " pod="kuadrant-system/authorino-6889cbd8c4-qk8bx"
Oct 30 20:55:07.453461 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.453383    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-qk8bx"
Oct 30 20:55:07.463502 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.463478    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-qk8bx"]
Oct 30 20:55:07.493361 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.493324    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-955f7db96-5qmdq"]
Oct 30 20:55:07.497503 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.497478    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-955f7db96-5qmdq"
Oct 30 20:55:07.504428 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.504403    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-955f7db96-5qmdq"]
Oct 30 20:55:07.559831 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.559789    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2998579d-0a9f-4aa6-ad96-bc256beea5d4-tls-cert\") pod \"authorino-955f7db96-5qmdq\" (UID: \"2998579d-0a9f-4aa6-ad96-bc256beea5d4\") " pod="kuadrant-system/authorino-955f7db96-5qmdq"
Oct 30 20:55:07.559831 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.559830    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhprk\" (UniqueName: \"kubernetes.io/projected/2998579d-0a9f-4aa6-ad96-bc256beea5d4-kube-api-access-jhprk\") pod \"authorino-955f7db96-5qmdq\" (UID: \"2998579d-0a9f-4aa6-ad96-bc256beea5d4\") " pod="kuadrant-system/authorino-955f7db96-5qmdq"
Oct 30 20:55:07.661199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.661153    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2998579d-0a9f-4aa6-ad96-bc256beea5d4-tls-cert\") pod \"authorino-955f7db96-5qmdq\" (UID: \"2998579d-0a9f-4aa6-ad96-bc256beea5d4\") " pod="kuadrant-system/authorino-955f7db96-5qmdq"
Oct 30 20:55:07.661199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.661196    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhprk\" (UniqueName: \"kubernetes.io/projected/2998579d-0a9f-4aa6-ad96-bc256beea5d4-kube-api-access-jhprk\") pod \"authorino-955f7db96-5qmdq\" (UID: \"2998579d-0a9f-4aa6-ad96-bc256beea5d4\") " pod="kuadrant-system/authorino-955f7db96-5qmdq"
Oct 30 20:55:07.663691 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.663664    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2998579d-0a9f-4aa6-ad96-bc256beea5d4-tls-cert\") pod \"authorino-955f7db96-5qmdq\" (UID: \"2998579d-0a9f-4aa6-ad96-bc256beea5d4\") " pod="kuadrant-system/authorino-955f7db96-5qmdq"
Oct 30 20:55:07.673943 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.673915    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhprk\" (UniqueName: \"kubernetes.io/projected/2998579d-0a9f-4aa6-ad96-bc256beea5d4-kube-api-access-jhprk\") pod \"authorino-955f7db96-5qmdq\" (UID: \"2998579d-0a9f-4aa6-ad96-bc256beea5d4\") " pod="kuadrant-system/authorino-955f7db96-5qmdq"
Oct 30 20:55:07.726695 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.726672    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-qk8bx"]
Oct 30 20:55:07.729887 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:55:07.729852    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf721ed8c_c06e_43d8_95fc_7b1d9deb8d24.slice/crio-ad70c7eb045357115d4386cac4d53f5670dab3882b36bf494db137c040535d78 WatchSource:0}: Error finding container ad70c7eb045357115d4386cac4d53f5670dab3882b36bf494db137c040535d78: Status 404 returned error can't find the container with id ad70c7eb045357115d4386cac4d53f5670dab3882b36bf494db137c040535d78
Oct 30 20:55:07.816944 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:07.816914    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-955f7db96-5qmdq"
Oct 30 20:55:08.091880 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:08.091851    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-955f7db96-5qmdq"]
Oct 30 20:55:08.094363 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:55:08.094336    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2998579d_0a9f_4aa6_ad96_bc256beea5d4.slice/crio-b4b1eb8b16ce379c0238d386a4c6e417807427fc2f04fe29c903d615c4027c38 WatchSource:0}: Error finding container b4b1eb8b16ce379c0238d386a4c6e417807427fc2f04fe29c903d615c4027c38: Status 404 returned error can't find the container with id b4b1eb8b16ce379c0238d386a4c6e417807427fc2f04fe29c903d615c4027c38
Oct 30 20:55:08.306075 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:08.306010    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-qk8bx" event={"ID":"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24","Type":"ContainerStarted","Data":"ad70c7eb045357115d4386cac4d53f5670dab3882b36bf494db137c040535d78"}
Oct 30 20:55:08.307227 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:08.307200    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-955f7db96-5qmdq" event={"ID":"2998579d-0a9f-4aa6-ad96-bc256beea5d4","Type":"ContainerStarted","Data":"b4b1eb8b16ce379c0238d386a4c6e417807427fc2f04fe29c903d615c4027c38"}
Oct 30 20:55:09.317303 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.317267    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-qk8bx" event={"ID":"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24","Type":"ContainerStarted","Data":"f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10"}
Oct 30 20:55:09.317735 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.317343    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6889cbd8c4-qk8bx" podUID="f721ed8c-c06e-43d8-95fc-7b1d9deb8d24" containerName="authorino" containerID="cri-o://f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10" gracePeriod=30
Oct 30 20:55:09.319528 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.319493    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-955f7db96-5qmdq" event={"ID":"2998579d-0a9f-4aa6-ad96-bc256beea5d4","Type":"ContainerStarted","Data":"7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35"}
Oct 30 20:55:09.356366 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.356291    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6889cbd8c4-qk8bx" podStartSLOduration=1.460574756 podStartE2EDuration="2.356271708s" totalImagesPullingTime="895.696952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:55:09.335988487 +0000 UTC m=+920.194724780" watchObservedRunningTime="2026-10-30 20:55:09.356271708 +0000 UTC m=+920.215008001"
Oct 30 20:55:09.386512 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.386453    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-955f7db96-5qmdq" podStartSLOduration=1.6753287430000001 podStartE2EDuration="2.386437455s" totalImagesPullingTime="711.108712ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:55:09.356253792 +0000 UTC m=+920.214990086" watchObservedRunningTime="2026-10-30 20:55:09.386437455 +0000 UTC m=+920.245173748"
Oct 30 20:55:09.386923 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.386905    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dk86k"]
Oct 30 20:55:09.387263 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.387100    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-dk86k" podUID="9e9271c2-84d0-435d-833f-4f8ee1a2420d" containerName="authorino" containerID="cri-o://52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905" gracePeriod=30
Oct 30 20:55:09.655354 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.655330    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-qk8bx"
Oct 30 20:55:09.658296 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.658276    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-dk86k"
Oct 30 20:55:09.687985 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.687950    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-kube-api-access-5d4vq\" (UniqueName: \"kubernetes.io/projected/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-kube-api-access-5d4vq\") pod \"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24\" (UID: \"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24\") "
Oct 30 20:55:09.688138 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.688063    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e9271c2-84d0-435d-833f-4f8ee1a2420d-kube-api-access-9tcwc\" (UniqueName: \"kubernetes.io/projected/9e9271c2-84d0-435d-833f-4f8ee1a2420d-kube-api-access-9tcwc\") pod \"9e9271c2-84d0-435d-833f-4f8ee1a2420d\" (UID: \"9e9271c2-84d0-435d-833f-4f8ee1a2420d\") "
Oct 30 20:55:09.688138 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.688108    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-tls-cert\" (UniqueName: \"kubernetes.io/secret/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-tls-cert\") pod \"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24\" (UID: \"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24\") "
Oct 30 20:55:09.691537 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.691512    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e9271c2-84d0-435d-833f-4f8ee1a2420d-kube-api-access-9tcwc" pod "9e9271c2-84d0-435d-833f-4f8ee1a2420d" (UID: "9e9271c2-84d0-435d-833f-4f8ee1a2420d"). InnerVolumeSpecName "kube-api-access-9tcwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:09.691707 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.691691    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-kube-api-access-5d4vq" pod "f721ed8c-c06e-43d8-95fc-7b1d9deb8d24" (UID: "f721ed8c-c06e-43d8-95fc-7b1d9deb8d24"). InnerVolumeSpecName "kube-api-access-5d4vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:09.699683 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.699657    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-tls-cert" pod "f721ed8c-c06e-43d8-95fc-7b1d9deb8d24" (UID: "f721ed8c-c06e-43d8-95fc-7b1d9deb8d24"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:09.789050 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.789002    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tcwc\" (UniqueName: \"kubernetes.io/projected/9e9271c2-84d0-435d-833f-4f8ee1a2420d-kube-api-access-9tcwc\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:55:09.789050 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.789046    6048 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-tls-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:55:09.789050 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:09.789056    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d4vq\" (UniqueName: \"kubernetes.io/projected/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24-kube-api-access-5d4vq\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:55:10.324585 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.324548    6048 generic.go:356] "Generic (PLEG): container finished" podID="f721ed8c-c06e-43d8-95fc-7b1d9deb8d24" containerID="f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10" exitCode=0
Oct 30 20:55:10.325056 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.324598    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-qk8bx"
Oct 30 20:55:10.325056 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.324630    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-qk8bx" event={"ID":"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24","Type":"ContainerDied","Data":"f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10"}
Oct 30 20:55:10.325056 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.324682    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-qk8bx" event={"ID":"f721ed8c-c06e-43d8-95fc-7b1d9deb8d24","Type":"ContainerDied","Data":"ad70c7eb045357115d4386cac4d53f5670dab3882b36bf494db137c040535d78"}
Oct 30 20:55:10.325056 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.324702    6048 scope.go:122] "RemoveContainer" containerID="f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10"
Oct 30 20:55:10.326043 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.326007    6048 generic.go:356] "Generic (PLEG): container finished" podID="9e9271c2-84d0-435d-833f-4f8ee1a2420d" containerID="52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905" exitCode=0
Oct 30 20:55:10.326117 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.326082    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-dk86k"
Oct 30 20:55:10.326163 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.326113    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-dk86k" event={"ID":"9e9271c2-84d0-435d-833f-4f8ee1a2420d","Type":"ContainerDied","Data":"52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905"}
Oct 30 20:55:10.326163 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.326140    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-dk86k" event={"ID":"9e9271c2-84d0-435d-833f-4f8ee1a2420d","Type":"ContainerDied","Data":"13454781d0c233c0ff6a791dd2f743488b12779ca4443ecdd87a817aa1a6a81f"}
Oct 30 20:55:10.337361 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.337224    6048 scope.go:122] "RemoveContainer" containerID="f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10"
Oct 30 20:55:10.337976 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:55:10.337953    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10\": container with ID starting with f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10 not found: ID does not exist" containerID="f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10"
Oct 30 20:55:10.338179 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.337985    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10"} err="failed to get container status \"f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10\": rpc error: code = NotFound desc = could not find container \"f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10\": container with ID starting with f8d9a0c4716fe653b75e9516eb696b20fd46c07cd106e84129352a5dd1262c10 not found: ID does not exist"
Oct 30 20:55:10.338179 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.338004    6048 scope.go:122] "RemoveContainer" containerID="52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905"
Oct 30 20:55:10.345770 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.345752    6048 scope.go:122] "RemoveContainer" containerID="52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905"
Oct 30 20:55:10.346032 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:55:10.345999    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905\": container with ID starting with 52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905 not found: ID does not exist" containerID="52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905"
Oct 30 20:55:10.346077 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.346046    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905"} err="failed to get container status \"52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905\": rpc error: code = NotFound desc = could not find container \"52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905\": container with ID starting with 52cfb61e729b23b61684b00bd0f4cbba004c297a56d699319c735d927fbb6905 not found: ID does not exist"
Oct 30 20:55:10.351580 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.351560    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-qk8bx"]
Oct 30 20:55:10.355620 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.355595    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-qk8bx"]
Oct 30 20:55:10.368869 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.368840    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dk86k"]
Oct 30 20:55:10.371269 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:10.371250    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dk86k"]
Oct 30 20:55:11.256989 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:11.256953    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e9271c2-84d0-435d-833f-4f8ee1a2420d" path="/var/lib/kubelet/pods/9e9271c2-84d0-435d-833f-4f8ee1a2420d/volumes"
Oct 30 20:55:11.257398 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:55:11.257378    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f721ed8c-c06e-43d8-95fc-7b1d9deb8d24" path="/var/lib/kubelet/pods/f721ed8c-c06e-43d8-95fc-7b1d9deb8d24/volumes"
Oct 30 20:55:16.800581 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:55:16.800544    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:55:46.800954 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:55:46.800915    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:56:04.597545 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.597508    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"]
Oct 30 20:56:04.597989 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.597856    6048 cpu_manager.go:414] "containerMap: removing container" podUID="9e9271c2-84d0-435d-833f-4f8ee1a2420d" containerName="authorino"
Oct 30 20:56:04.597989 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.597868    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e9271c2-84d0-435d-833f-4f8ee1a2420d" containerName="authorino"
Oct 30 20:56:04.597989 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.597899    6048 cpu_manager.go:414] "containerMap: removing container" podUID="f721ed8c-c06e-43d8-95fc-7b1d9deb8d24" containerName="authorino"
Oct 30 20:56:04.597989 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.597904    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f721ed8c-c06e-43d8-95fc-7b1d9deb8d24" containerName="authorino"
Oct 30 20:56:04.597989 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.597979    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e9271c2-84d0-435d-833f-4f8ee1a2420d" containerName="authorino"
Oct 30 20:56:04.597989 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.597992    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="f721ed8c-c06e-43d8-95fc-7b1d9deb8d24" containerName="authorino"
Oct 30 20:56:04.602657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.602638    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.610939 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.610919    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-75544\""
Oct 30 20:56:04.611092 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.610948    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Oct 30 20:56:04.612397 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.612377    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 20:56:04.612489 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.612474    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 20:56:04.613602 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.613579    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"]
Oct 30 20:56:04.671356 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.671329    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18730625-e6ba-421a-9a27-02acc29e9a2b-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.671356 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.671360    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18730625-e6ba-421a-9a27-02acc29e9a2b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.671594 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.671392    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq8j2\" (UniqueName: \"kubernetes.io/projected/18730625-e6ba-421a-9a27-02acc29e9a2b-kube-api-access-vq8j2\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.671594 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.671474    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18730625-e6ba-421a-9a27-02acc29e9a2b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.671735 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.671595    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18730625-e6ba-421a-9a27-02acc29e9a2b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.671735 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.671697    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18730625-e6ba-421a-9a27-02acc29e9a2b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.772533 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.772483    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq8j2\" (UniqueName: \"kubernetes.io/projected/18730625-e6ba-421a-9a27-02acc29e9a2b-kube-api-access-vq8j2\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.772710 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.772556    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18730625-e6ba-421a-9a27-02acc29e9a2b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.772710 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.772582    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18730625-e6ba-421a-9a27-02acc29e9a2b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.772710 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.772634    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18730625-e6ba-421a-9a27-02acc29e9a2b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.772710 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.772704    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18730625-e6ba-421a-9a27-02acc29e9a2b-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.772928 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.772728    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18730625-e6ba-421a-9a27-02acc29e9a2b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.772987 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.772918    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18730625-e6ba-421a-9a27-02acc29e9a2b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.773083 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.773063    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18730625-e6ba-421a-9a27-02acc29e9a2b-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.773153 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.773141    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18730625-e6ba-421a-9a27-02acc29e9a2b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.775114 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.775088    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18730625-e6ba-421a-9a27-02acc29e9a2b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.775347 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.775330    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18730625-e6ba-421a-9a27-02acc29e9a2b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.784863 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.784836    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq8j2\" (UniqueName: \"kubernetes.io/projected/18730625-e6ba-421a-9a27-02acc29e9a2b-kube-api-access-vq8j2\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm\" (UID: \"18730625-e6ba-421a-9a27-02acc29e9a2b\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:04.916157 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:04.916070    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:05.191186 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:05.191060    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"]
Oct 30 20:56:05.194641 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:56:05.194608    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18730625_e6ba_421a_9a27_02acc29e9a2b.slice/crio-3d0ae3cfe5ab6b911ae9983470a6cb4d1e344a40bdd99f4653441a88af78a5ec WatchSource:0}: Error finding container 3d0ae3cfe5ab6b911ae9983470a6cb4d1e344a40bdd99f4653441a88af78a5ec: Status 404 returned error can't find the container with id 3d0ae3cfe5ab6b911ae9983470a6cb4d1e344a40bdd99f4653441a88af78a5ec
Oct 30 20:56:05.572044 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:05.571982    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" event={"ID":"18730625-e6ba-421a-9a27-02acc29e9a2b","Type":"ContainerStarted","Data":"3d0ae3cfe5ab6b911ae9983470a6cb4d1e344a40bdd99f4653441a88af78a5ec"}
Oct 30 20:56:07.584979 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:07.584939    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" event={"ID":"18730625-e6ba-421a-9a27-02acc29e9a2b","Type":"ContainerStarted","Data":"0d7ebba9812d08a9544c0031a8c10119ab231bab150c2cc9a0e0c4ee65892484"}
Oct 30 20:56:07.646307 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:07.646247    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podStartSLOduration=2.327366989 podStartE2EDuration="3.646231242s" totalImagesPullingTime="1.318864253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:07.64412358 +0000 UTC m=+978.502859872" watchObservedRunningTime="2026-10-30 20:56:07.646231242 +0000 UTC m=+978.504967527"
Oct 30 20:56:07.917178 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:07.917094    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:08.195340 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.195261    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"]
Oct 30 20:56:08.199074 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.199053    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.203383 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.203359    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Oct 30 20:56:08.209572 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.209549    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"]
Oct 30 20:56:08.307485 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.307452    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e668cd9-0cf1-4ab4-94da-0e283fd10653-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.307641 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.307564    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e668cd9-0cf1-4ab4-94da-0e283fd10653-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.307641 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.307593    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e668cd9-0cf1-4ab4-94da-0e283fd10653-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.307641 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.307617    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdx2d\" (UniqueName: \"kubernetes.io/projected/2e668cd9-0cf1-4ab4-94da-0e283fd10653-kube-api-access-hdx2d\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.307773 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.307735    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e668cd9-0cf1-4ab4-94da-0e283fd10653-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.307822 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.307806    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e668cd9-0cf1-4ab4-94da-0e283fd10653-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.408820 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.408782    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e668cd9-0cf1-4ab4-94da-0e283fd10653-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.408820 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.408824    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e668cd9-0cf1-4ab4-94da-0e283fd10653-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.409095 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.408844    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdx2d\" (UniqueName: \"kubernetes.io/projected/2e668cd9-0cf1-4ab4-94da-0e283fd10653-kube-api-access-hdx2d\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.409095 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.408899    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e668cd9-0cf1-4ab4-94da-0e283fd10653-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.409095 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.408961    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e668cd9-0cf1-4ab4-94da-0e283fd10653-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.409095 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.408995    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e668cd9-0cf1-4ab4-94da-0e283fd10653-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.409302 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.409284    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e668cd9-0cf1-4ab4-94da-0e283fd10653-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.409361 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.409319    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e668cd9-0cf1-4ab4-94da-0e283fd10653-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.409412 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.409360    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e668cd9-0cf1-4ab4-94da-0e283fd10653-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.411230 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.411203    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e668cd9-0cf1-4ab4-94da-0e283fd10653-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.411445 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.411429    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e668cd9-0cf1-4ab4-94da-0e283fd10653-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.421274 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.421244    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdx2d\" (UniqueName: \"kubernetes.io/projected/2e668cd9-0cf1-4ab4-94da-0e283fd10653-kube-api-access-hdx2d\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-7cjqv\" (UID: \"2e668cd9-0cf1-4ab4-94da-0e283fd10653\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.512446 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.512359    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:08.835315 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:08.835287    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"]
Oct 30 20:56:08.837789 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:56:08.837750    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e668cd9_0cf1_4ab4_94da_0e283fd10653.slice/crio-92b153e298b8925122add6fe8428041c34097f9cd56be3f7a1d4ba4fb3adfb8f WatchSource:0}: Error finding container 92b153e298b8925122add6fe8428041c34097f9cd56be3f7a1d4ba4fb3adfb8f: Status 404 returned error can't find the container with id 92b153e298b8925122add6fe8428041c34097f9cd56be3f7a1d4ba4fb3adfb8f
Oct 30 20:56:09.377676 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.377643    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"]
Oct 30 20:56:09.381306 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.381284    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.386096 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.386075    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 30 20:56:09.392716 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.392689    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"]
Oct 30 20:56:09.419623 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.419546    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22853c99-79a5-42c6-a102-a1a958194465-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.419623 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.419594    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22853c99-79a5-42c6-a102-a1a958194465-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.419833 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.419735    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22853c99-79a5-42c6-a102-a1a958194465-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.419833 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.419818    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22853c99-79a5-42c6-a102-a1a958194465-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.419968 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.419905    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22853c99-79a5-42c6-a102-a1a958194465-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.419968 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.419950    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwwvj\" (UniqueName: \"kubernetes.io/projected/22853c99-79a5-42c6-a102-a1a958194465-kube-api-access-rwwvj\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.521447 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.521408    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22853c99-79a5-42c6-a102-a1a958194465-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.521618 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.521459    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22853c99-79a5-42c6-a102-a1a958194465-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.521618 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.521551    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwwvj\" (UniqueName: \"kubernetes.io/projected/22853c99-79a5-42c6-a102-a1a958194465-kube-api-access-rwwvj\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.521618 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.521603    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22853c99-79a5-42c6-a102-a1a958194465-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.521838 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.521654    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22853c99-79a5-42c6-a102-a1a958194465-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.521838 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.521690    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22853c99-79a5-42c6-a102-a1a958194465-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.521838 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.521824    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22853c99-79a5-42c6-a102-a1a958194465-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.521994 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.521921    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22853c99-79a5-42c6-a102-a1a958194465-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.522107 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.522086    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22853c99-79a5-42c6-a102-a1a958194465-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.523967 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.523931    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22853c99-79a5-42c6-a102-a1a958194465-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.524259 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.524239    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22853c99-79a5-42c6-a102-a1a958194465-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.534302 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.534276    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwwvj\" (UniqueName: \"kubernetes.io/projected/22853c99-79a5-42c6-a102-a1a958194465-kube-api-access-rwwvj\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-67npv\" (UID: \"22853c99-79a5-42c6-a102-a1a958194465\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.595691 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.595652    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv" event={"ID":"2e668cd9-0cf1-4ab4-94da-0e283fd10653","Type":"ContainerStarted","Data":"36031e6efbe7cb30e6b27fb1da7f499cf3026a7da4a658c0e3c4158b786fb9f3"}
Oct 30 20:56:09.595870 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.595717    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv" event={"ID":"2e668cd9-0cf1-4ab4-94da-0e283fd10653","Type":"ContainerStarted","Data":"92b153e298b8925122add6fe8428041c34097f9cd56be3f7a1d4ba4fb3adfb8f"}
Oct 30 20:56:09.697408 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.697317    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:09.972593 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.972493    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv" podStartSLOduration=1.6589562359999999 podStartE2EDuration="1.972477845s" totalImagesPullingTime="313.521609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:09.616998118 +0000 UTC m=+980.475734412" watchObservedRunningTime="2026-10-30 20:56:09.972477845 +0000 UTC m=+980.831214137"
Oct 30 20:56:09.973600 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:09.973579    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"]
Oct 30 20:56:09.976641 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:56:09.976604    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22853c99_79a5_42c6_a102_a1a958194465.slice/crio-be3391fcc13e1daef2d969e77e612f3d1df0d994eafa7a88f9fe36f8b6e73eda WatchSource:0}: Error finding container be3391fcc13e1daef2d969e77e612f3d1df0d994eafa7a88f9fe36f8b6e73eda: Status 404 returned error can't find the container with id be3391fcc13e1daef2d969e77e612f3d1df0d994eafa7a88f9fe36f8b6e73eda
Oct 30 20:56:10.513098 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:10.513060    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:10.601801 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:10.601758    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv" event={"ID":"22853c99-79a5-42c6-a102-a1a958194465","Type":"ContainerStarted","Data":"712f8c627a40a3c53ac0395f3d912974c14d0a414091c0d23c27d297498c0dc7"}
Oct 30 20:56:10.601964 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:10.601823    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv" event={"ID":"22853c99-79a5-42c6-a102-a1a958194465","Type":"ContainerStarted","Data":"be3391fcc13e1daef2d969e77e612f3d1df0d994eafa7a88f9fe36f8b6e73eda"}
Oct 30 20:56:10.623650 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:10.623592    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv" podStartSLOduration=1.324442479 podStartE2EDuration="1.623577828s" totalImagesPullingTime="299.135349ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:10.622567924 +0000 UTC m=+981.481304217" watchObservedRunningTime="2026-10-30 20:56:10.623577828 +0000 UTC m=+981.482314121"
Oct 30 20:56:10.698274 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:10.698235    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:11.622109 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.622075    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"]
Oct 30 20:56:11.625715 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.625695    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.630576 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.630552    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Oct 30 20:56:11.639698 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.639671    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"]
Oct 30 20:56:11.744607 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.744561    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/527d331c-7255-4a2a-be33-40a2c8a16b25-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.744790 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.744622    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/527d331c-7255-4a2a-be33-40a2c8a16b25-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.744790 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.744708    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/527d331c-7255-4a2a-be33-40a2c8a16b25-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.744790 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.744753    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls9mr\" (UniqueName: \"kubernetes.io/projected/527d331c-7255-4a2a-be33-40a2c8a16b25-kube-api-access-ls9mr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.744790 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.744786    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/527d331c-7255-4a2a-be33-40a2c8a16b25-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.744971 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.744809    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/527d331c-7255-4a2a-be33-40a2c8a16b25-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.846150 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.846108    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/527d331c-7255-4a2a-be33-40a2c8a16b25-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.846364 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.846171    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/527d331c-7255-4a2a-be33-40a2c8a16b25-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.846364 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.846197    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/527d331c-7255-4a2a-be33-40a2c8a16b25-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.846364 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.846219    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls9mr\" (UniqueName: \"kubernetes.io/projected/527d331c-7255-4a2a-be33-40a2c8a16b25-kube-api-access-ls9mr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.846364 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.846261    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/527d331c-7255-4a2a-be33-40a2c8a16b25-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.846364 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.846291    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/527d331c-7255-4a2a-be33-40a2c8a16b25-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.846747 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.846725    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/527d331c-7255-4a2a-be33-40a2c8a16b25-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.846866 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.846840    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/527d331c-7255-4a2a-be33-40a2c8a16b25-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.847078 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.847061    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/527d331c-7255-4a2a-be33-40a2c8a16b25-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.849183 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.849156    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/527d331c-7255-4a2a-be33-40a2c8a16b25-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.849365 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.849350    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/527d331c-7255-4a2a-be33-40a2c8a16b25-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.861010 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.860985    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls9mr\" (UniqueName: \"kubernetes.io/projected/527d331c-7255-4a2a-be33-40a2c8a16b25-kube-api-access-ls9mr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj\" (UID: \"527d331c-7255-4a2a-be33-40a2c8a16b25\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:11.943734 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:11.943660    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:12.218440 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:12.218358    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"]
Oct 30 20:56:12.221637 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:56:12.221608    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527d331c_7255_4a2a_be33_40a2c8a16b25.slice/crio-97ba3246397b4539f808c35f2960b51a782c7380534002c7fcfa9611ca47be5b WatchSource:0}: Error finding container 97ba3246397b4539f808c35f2960b51a782c7380534002c7fcfa9611ca47be5b: Status 404 returned error can't find the container with id 97ba3246397b4539f808c35f2960b51a782c7380534002c7fcfa9611ca47be5b
Oct 30 20:56:12.612924 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:12.612885    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj" event={"ID":"527d331c-7255-4a2a-be33-40a2c8a16b25","Type":"ContainerStarted","Data":"1148df7b549279e2e8579b8df2bf5d68585a7e191bbdaf6f6231fb67c7fdbb90"}
Oct 30 20:56:12.613127 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:12.612950    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj" event={"ID":"527d331c-7255-4a2a-be33-40a2c8a16b25","Type":"ContainerStarted","Data":"97ba3246397b4539f808c35f2960b51a782c7380534002c7fcfa9611ca47be5b"}
Oct 30 20:56:12.633818 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:12.633761    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj" podStartSLOduration=1.349099439 podStartE2EDuration="1.63374521s" totalImagesPullingTime="284.645771ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:12.633262219 +0000 UTC m=+983.491998513" watchObservedRunningTime="2026-10-30 20:56:12.63374521 +0000 UTC m=+983.492481504"
Oct 30 20:56:12.944098 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:12.944065    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:14.917279 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:14.917230    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:14.929777 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:14.929744    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:15.639120 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:15.639088    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 20:56:16.803590 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:56:16.803549    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:56:18.512673 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:18.512637    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:18.525524 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:18.525495    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:18.655488 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:18.655456    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-7cjqv"
Oct 30 20:56:19.697724 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:19.697694    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:19.712695 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:19.712670    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:20.663471 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:20.663441    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-67npv"
Oct 30 20:56:21.944200 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:21.944166    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:21.956515 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:21.956493    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:22.672151 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:22.672124    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj"
Oct 30 20:56:24.266149 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.266114    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"]
Oct 30 20:56:24.269827 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.269802    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.280289 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.280266    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 20:56:24.285775 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.285750    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"]
Oct 30 20:56:24.358862 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.358828    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6qg5v\""
Oct 30 20:56:24.366295 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.366270    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.366389 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.366321    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.366433 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.366393    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.366546 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.366527    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.366605 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.366571    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.366658 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.366603    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.366720 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.366705    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7l9r\" (UniqueName: \"kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-kube-api-access-c7l9r\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.366770 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.366759    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/551ccd40-6ea1-451e-ade9-861cb41ff304-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.366804 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.366790    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468104 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468009    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468304 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468120    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468304 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468145    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468304 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468189    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7l9r\" (UniqueName: \"kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-kube-api-access-c7l9r\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468304 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468251    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/551ccd40-6ea1-451e-ade9-861cb41ff304-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468513 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468323    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468513 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468411    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468513 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468443    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468513 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468474    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468723 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468549    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468723 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468598    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468723 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468608    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.468878 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.468727    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.469092 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.469072    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/551ccd40-6ea1-451e-ade9-861cb41ff304-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.470630 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.470605    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.470721 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.470643    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.481135 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.481108    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.481285 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.481268    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7l9r\" (UniqueName: \"kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-kube-api-access-c7l9r\") pod \"maas-default-gateway-openshift-default-58c6585447-p9h5g\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.583408 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.583353    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:24.863494 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.863467    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"]
Oct 30 20:56:24.866071 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:56:24.866041    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551ccd40_6ea1_451e_ade9_861cb41ff304.slice/crio-ebc5d40d7930a924e340db7dc8d2e34df4796780912d203445015e1747075bd4 WatchSource:0}: Error finding container ebc5d40d7930a924e340db7dc8d2e34df4796780912d203445015e1747075bd4: Status 404 returned error can't find the container with id ebc5d40d7930a924e340db7dc8d2e34df4796780912d203445015e1747075bd4
Oct 30 20:56:24.910200 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.910172    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c5b95d667-8hlfb"]
Oct 30 20:56:24.914982 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.914963    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c5b95d667-8hlfb"
Oct 30 20:56:24.921305 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:24.921280    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c5b95d667-8hlfb"]
Oct 30 20:56:25.077617 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:25.077576    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/149e626e-7322-4454-8561-b174b7188894-tls-cert\") pod \"authorino-7c5b95d667-8hlfb\" (UID: \"149e626e-7322-4454-8561-b174b7188894\") " pod="kuadrant-system/authorino-7c5b95d667-8hlfb"
Oct 30 20:56:25.077824 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:25.077741    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4j5t\" (UniqueName: \"kubernetes.io/projected/149e626e-7322-4454-8561-b174b7188894-kube-api-access-n4j5t\") pod \"authorino-7c5b95d667-8hlfb\" (UID: \"149e626e-7322-4454-8561-b174b7188894\") " pod="kuadrant-system/authorino-7c5b95d667-8hlfb"
Oct 30 20:56:25.178673 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:25.178590    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/149e626e-7322-4454-8561-b174b7188894-tls-cert\") pod \"authorino-7c5b95d667-8hlfb\" (UID: \"149e626e-7322-4454-8561-b174b7188894\") " pod="kuadrant-system/authorino-7c5b95d667-8hlfb"
Oct 30 20:56:25.178851 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:25.178672    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4j5t\" (UniqueName: \"kubernetes.io/projected/149e626e-7322-4454-8561-b174b7188894-kube-api-access-n4j5t\") pod \"authorino-7c5b95d667-8hlfb\" (UID: \"149e626e-7322-4454-8561-b174b7188894\") " pod="kuadrant-system/authorino-7c5b95d667-8hlfb"
Oct 30 20:56:25.181186 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:25.181162    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/149e626e-7322-4454-8561-b174b7188894-tls-cert\") pod \"authorino-7c5b95d667-8hlfb\" (UID: \"149e626e-7322-4454-8561-b174b7188894\") " pod="kuadrant-system/authorino-7c5b95d667-8hlfb"
Oct 30 20:56:25.191223 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:25.191201    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4j5t\" (UniqueName: \"kubernetes.io/projected/149e626e-7322-4454-8561-b174b7188894-kube-api-access-n4j5t\") pod \"authorino-7c5b95d667-8hlfb\" (UID: \"149e626e-7322-4454-8561-b174b7188894\") " pod="kuadrant-system/authorino-7c5b95d667-8hlfb"
Oct 30 20:56:25.228300 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:25.228276    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c5b95d667-8hlfb"
Oct 30 20:56:25.499523 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:25.499492    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c5b95d667-8hlfb"]
Oct 30 20:56:25.502455 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:56:25.502430    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod149e626e_7322_4454_8561_b174b7188894.slice/crio-588a8f294d304d5eeb7845cb3f2a5894b8f94780235843d7accc88458fd9b8ec WatchSource:0}: Error finding container 588a8f294d304d5eeb7845cb3f2a5894b8f94780235843d7accc88458fd9b8ec: Status 404 returned error can't find the container with id 588a8f294d304d5eeb7845cb3f2a5894b8f94780235843d7accc88458fd9b8ec
Oct 30 20:56:25.676393 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:25.676345    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c5b95d667-8hlfb" event={"ID":"149e626e-7322-4454-8561-b174b7188894","Type":"ContainerStarted","Data":"588a8f294d304d5eeb7845cb3f2a5894b8f94780235843d7accc88458fd9b8ec"}
Oct 30 20:56:25.677573 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:25.677547    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" event={"ID":"551ccd40-6ea1-451e-ade9-861cb41ff304","Type":"ContainerStarted","Data":"ebc5d40d7930a924e340db7dc8d2e34df4796780912d203445015e1747075bd4"}
Oct 30 20:56:26.692273 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:26.692240    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c5b95d667-8hlfb" event={"ID":"149e626e-7322-4454-8561-b174b7188894","Type":"ContainerStarted","Data":"74301039b42097f415b017a23767fcb63fb5965905653e5936d96b6f49f3e9eb"}
Oct 30 20:56:26.714512 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:26.714450    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-7c5b95d667-8hlfb" podStartSLOduration=1.916978281 podStartE2EDuration="2.714434689s" totalImagesPullingTime="797.456408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:26.712935674 +0000 UTC m=+997.571671964" watchObservedRunningTime="2026-10-30 20:56:26.714434689 +0000 UTC m=+997.573170983"
Oct 30 20:56:26.749167 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:26.749128    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-955f7db96-5qmdq"]
Oct 30 20:56:26.749362 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:26.749333    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-955f7db96-5qmdq" podUID="2998579d-0a9f-4aa6-ad96-bc256beea5d4" containerName="authorino" containerID="cri-o://7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35" gracePeriod=30
Oct 30 20:56:27.070822 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.070793    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-955f7db96-5qmdq"
Oct 30 20:56:27.200926 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.200896    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2998579d-0a9f-4aa6-ad96-bc256beea5d4-kube-api-access-jhprk\" (UniqueName: \"kubernetes.io/projected/2998579d-0a9f-4aa6-ad96-bc256beea5d4-kube-api-access-jhprk\") pod \"2998579d-0a9f-4aa6-ad96-bc256beea5d4\" (UID: \"2998579d-0a9f-4aa6-ad96-bc256beea5d4\") "
Oct 30 20:56:27.201140 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.200948    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2998579d-0a9f-4aa6-ad96-bc256beea5d4-tls-cert\" (UniqueName: \"kubernetes.io/secret/2998579d-0a9f-4aa6-ad96-bc256beea5d4-tls-cert\") pod \"2998579d-0a9f-4aa6-ad96-bc256beea5d4\" (UID: \"2998579d-0a9f-4aa6-ad96-bc256beea5d4\") "
Oct 30 20:56:27.203347 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.203314    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2998579d-0a9f-4aa6-ad96-bc256beea5d4-kube-api-access-jhprk" pod "2998579d-0a9f-4aa6-ad96-bc256beea5d4" (UID: "2998579d-0a9f-4aa6-ad96-bc256beea5d4"). InnerVolumeSpecName "kube-api-access-jhprk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:27.214359 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.214302    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2998579d-0a9f-4aa6-ad96-bc256beea5d4-tls-cert" pod "2998579d-0a9f-4aa6-ad96-bc256beea5d4" (UID: "2998579d-0a9f-4aa6-ad96-bc256beea5d4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:27.302270 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.302230    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhprk\" (UniqueName: \"kubernetes.io/projected/2998579d-0a9f-4aa6-ad96-bc256beea5d4-kube-api-access-jhprk\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:27.302270 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.302259    6048 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2998579d-0a9f-4aa6-ad96-bc256beea5d4-tls-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:56:27.700158 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.700125    6048 generic.go:356] "Generic (PLEG): container finished" podID="2998579d-0a9f-4aa6-ad96-bc256beea5d4" containerID="7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35" exitCode=0
Oct 30 20:56:27.700723 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.700165    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-955f7db96-5qmdq"
Oct 30 20:56:27.700723 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.700209    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-955f7db96-5qmdq" event={"ID":"2998579d-0a9f-4aa6-ad96-bc256beea5d4","Type":"ContainerDied","Data":"7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35"}
Oct 30 20:56:27.700723 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.700253    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-955f7db96-5qmdq" event={"ID":"2998579d-0a9f-4aa6-ad96-bc256beea5d4","Type":"ContainerDied","Data":"b4b1eb8b16ce379c0238d386a4c6e417807427fc2f04fe29c903d615c4027c38"}
Oct 30 20:56:27.700723 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.700273    6048 scope.go:122] "RemoveContainer" containerID="7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35"
Oct 30 20:56:27.712326 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.712299    6048 scope.go:122] "RemoveContainer" containerID="7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35"
Oct 30 20:56:27.712651 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:56:27.712620    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35\": container with ID starting with 7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35 not found: ID does not exist" containerID="7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35"
Oct 30 20:56:27.712757 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.712666    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35"} err="failed to get container status \"7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35\": rpc error: code = NotFound desc = could not find container \"7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35\": container with ID starting with 7286c503eb53d50b5657854f60eecd857087428e10cbfd00e0b7fcc14c872b35 not found: ID does not exist"
Oct 30 20:56:27.717424 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.717399    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-955f7db96-5qmdq"]
Oct 30 20:56:27.721410 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:27.721385    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-955f7db96-5qmdq"]
Oct 30 20:56:28.917247 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:28.917213    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:28.917639 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:28.917295    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:28.917639 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:28.917341    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:29.259335 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:29.259246    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2998579d-0a9f-4aa6-ad96-bc256beea5d4" path="/var/lib/kubelet/pods/2998579d-0a9f-4aa6-ad96-bc256beea5d4/volumes"
Oct 30 20:56:29.713878 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:29.713844    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" event={"ID":"551ccd40-6ea1-451e-ade9-861cb41ff304","Type":"ContainerStarted","Data":"0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147"}
Oct 30 20:56:29.739677 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:29.739611    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" podStartSLOduration=1.69149105 podStartE2EDuration="5.739590372s" totalImagesPullingTime="4.048099322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:29.738861546 +0000 UTC m=+1000.597597839" watchObservedRunningTime="2026-10-30 20:56:29.739590372 +0000 UTC m=+1000.598326666"
Oct 30 20:56:30.584107 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:30.584070    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:30.585433 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:30.585405    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-p9h5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:56:30.585571 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:30.585463    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 20:56:31.584699 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:31.584664    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-p9h5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:56:31.585212 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:31.584723    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 20:56:32.584654 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:32.584613    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-p9h5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:56:32.584824 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:32.584680    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 20:56:33.584503 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:33.584465    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-p9h5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:56:33.584666 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:33.584520    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 20:56:34.584428 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:34.584388    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-p9h5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:56:34.584995 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:34.584961    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 20:56:35.584109 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:35.584074    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-p9h5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Oct 30 20:56:35.584288 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:35.584130    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Oct 30 20:56:37.585055 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:37.585005    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-p9h5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:56:37.585539 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:37.585084    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:38.627209 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:38.627171    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-p9h5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 20:56:38.627653 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:38.627235    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 20:56:39.258300 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.258266    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:39.258714 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.258691    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:39.259598 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.259581    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 20:56:39.275852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.275819    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"]
Oct 30 20:56:39.276302 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.276286    6048 cpu_manager.go:414] "containerMap: removing container" podUID="2998579d-0a9f-4aa6-ad96-bc256beea5d4" containerName="authorino"
Oct 30 20:56:39.276302 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.276303    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2998579d-0a9f-4aa6-ad96-bc256beea5d4" containerName="authorino"
Oct 30 20:56:39.276411 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.276402    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="2998579d-0a9f-4aa6-ad96-bc256beea5d4" containerName="authorino"
Oct 30 20:56:39.278950 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.278929    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.295464 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.295438    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"]
Oct 30 20:56:39.358616 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.358572    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.358783 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.358620    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zk59\" (UniqueName: \"kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-kube-api-access-4zk59\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.359008 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.358982    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.359198 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.359174    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.359308 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.359214    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.359308 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.359246    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.359432 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.359304    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.359555 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.359533    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.359616 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.359589    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eeecf4c-4044-477d-8e01-9084d00a00cd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.460857 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.460821    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.460857 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.460861    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zk59\" (UniqueName: \"kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-kube-api-access-4zk59\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.461143 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.461048    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.461143 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.461085    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.461143 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.461103    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.461289 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.461221    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.461289 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.461231    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.461289 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.461259    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.461408 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.461368    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.461448 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.461421    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.461482 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.461430    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eeecf4c-4044-477d-8e01-9084d00a00cd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.461531 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.461490    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.461679 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.461661    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.461979 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.461960    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eeecf4c-4044-477d-8e01-9084d00a00cd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.463387 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.463362    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.463669 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.463652    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.485615 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.485582    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.490728 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.490701    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zk59\" (UniqueName: \"kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-kube-api-access-4zk59\") pod \"maas-default-gateway-openshift-default-58c6585447-gp2wl\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.592298 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.592269    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:39.874927 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.874819    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"]
Oct 30 20:56:39.878433 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:56:39.878403    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eeecf4c_4044_477d_8e01_9084d00a00cd.slice/crio-02d7f782ea5d5dba5df23b579b018539531e1a8585f82bb289fe7fe85201c519 WatchSource:0}: Error finding container 02d7f782ea5d5dba5df23b579b018539531e1a8585f82bb289fe7fe85201c519: Status 404 returned error can't find the container with id 02d7f782ea5d5dba5df23b579b018539531e1a8585f82bb289fe7fe85201c519
Oct 30 20:56:39.881483 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.881453    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:39.881555 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.881531    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:39.881596 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:39.881567    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:40.773953 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:40.773912    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" event={"ID":"5eeecf4c-4044-477d-8e01-9084d00a00cd","Type":"ContainerStarted","Data":"61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2"}
Oct 30 20:56:40.774209 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:40.773980    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" event={"ID":"5eeecf4c-4044-477d-8e01-9084d00a00cd","Type":"ContainerStarted","Data":"02d7f782ea5d5dba5df23b579b018539531e1a8585f82bb289fe7fe85201c519"}
Oct 30 20:56:40.801441 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:40.801394    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" podStartSLOduration=1.801378847 podStartE2EDuration="1.801378847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:40.799046364 +0000 UTC m=+1011.657782650" watchObservedRunningTime="2026-10-30 20:56:40.801378847 +0000 UTC m=+1011.660115140"
Oct 30 20:56:41.592743 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:41.592710    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:41.594057 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:41.594033    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gp2wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Oct 30 20:56:41.594116 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:41.594096    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Oct 30 20:56:42.079290 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.079260    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"]
Oct 30 20:56:42.084478 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.084457    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"
Oct 30 20:56:42.089413 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.089392    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Oct 30 20:56:42.093987 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.093960    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"]
Oct 30 20:56:42.094248 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.094227    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-hfjnx\""
Oct 30 20:56:42.094395 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.094353    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Oct 30 20:56:42.187809 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.187777    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xbsq\" (UniqueName: \"kubernetes.io/projected/bbf23b33-ae8e-4619-a7a1-c91ab5f67309-kube-api-access-7xbsq\") pod \"ai-gateway-controller-65c58bd4f6-5f68v\" (UID: \"bbf23b33-ae8e-4619-a7a1-c91ab5f67309\") " pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"
Oct 30 20:56:42.187959 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.187820    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbf23b33-ae8e-4619-a7a1-c91ab5f67309-metrics-certs\") pod \"ai-gateway-controller-65c58bd4f6-5f68v\" (UID: \"bbf23b33-ae8e-4619-a7a1-c91ab5f67309\") " pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"
Oct 30 20:56:42.288302 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.288266    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xbsq\" (UniqueName: \"kubernetes.io/projected/bbf23b33-ae8e-4619-a7a1-c91ab5f67309-kube-api-access-7xbsq\") pod \"ai-gateway-controller-65c58bd4f6-5f68v\" (UID: \"bbf23b33-ae8e-4619-a7a1-c91ab5f67309\") " pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"
Oct 30 20:56:42.288463 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.288312    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbf23b33-ae8e-4619-a7a1-c91ab5f67309-metrics-certs\") pod \"ai-gateway-controller-65c58bd4f6-5f68v\" (UID: \"bbf23b33-ae8e-4619-a7a1-c91ab5f67309\") " pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"
Oct 30 20:56:42.290744 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.290715    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbf23b33-ae8e-4619-a7a1-c91ab5f67309-metrics-certs\") pod \"ai-gateway-controller-65c58bd4f6-5f68v\" (UID: \"bbf23b33-ae8e-4619-a7a1-c91ab5f67309\") " pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"
Oct 30 20:56:42.301129 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.301102    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xbsq\" (UniqueName: \"kubernetes.io/projected/bbf23b33-ae8e-4619-a7a1-c91ab5f67309-kube-api-access-7xbsq\") pod \"ai-gateway-controller-65c58bd4f6-5f68v\" (UID: \"bbf23b33-ae8e-4619-a7a1-c91ab5f67309\") " pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"
Oct 30 20:56:42.398629 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.398540    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"
Oct 30 20:56:42.592853 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.592818    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gp2wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Oct 30 20:56:42.593291 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.592870    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Oct 30 20:56:42.698873 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.698820    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"]
Oct 30 20:56:42.701084 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:56:42.701055    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf23b33_ae8e_4619_a7a1_c91ab5f67309.slice/crio-7622be2be5e8ddca5681057f5a52cc0b5c939884bf6c3c788fc1d08d4f1103f0 WatchSource:0}: Error finding container 7622be2be5e8ddca5681057f5a52cc0b5c939884bf6c3c788fc1d08d4f1103f0: Status 404 returned error can't find the container with id 7622be2be5e8ddca5681057f5a52cc0b5c939884bf6c3c788fc1d08d4f1103f0
Oct 30 20:56:42.784491 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:42.784453    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v" event={"ID":"bbf23b33-ae8e-4619-a7a1-c91ab5f67309","Type":"ContainerStarted","Data":"7622be2be5e8ddca5681057f5a52cc0b5c939884bf6c3c788fc1d08d4f1103f0"}
Oct 30 20:56:43.593942 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:43.593572    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gp2wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Oct 30 20:56:43.593942 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:43.593633    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Oct 30 20:56:44.593447 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:44.593404    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gp2wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Oct 30 20:56:44.593617 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:44.593461    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Oct 30 20:56:45.592630 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:45.592598    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gp2wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Oct 30 20:56:45.593010 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:45.592659    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Oct 30 20:56:45.802043 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:45.801998    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v" event={"ID":"bbf23b33-ae8e-4619-a7a1-c91ab5f67309","Type":"ContainerStarted","Data":"41645a869830a354e1d70a83bb3738feb2f628aaadbc88d251171d31c99df9b6"}
Oct 30 20:56:45.802318 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:45.802134    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"
Oct 30 20:56:45.824155 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:45.824101    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v" podStartSLOduration=0.863660372 podStartE2EDuration="3.824083388s" totalImagesPullingTime="2.960423016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:45.82167892 +0000 UTC m=+1016.680415213" watchObservedRunningTime="2026-10-30 20:56:45.824083388 +0000 UTC m=+1016.682819681"
Oct 30 20:56:46.593550 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:46.593508    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gp2wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Oct 30 20:56:46.593950 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:46.593566    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Oct 30 20:56:46.800879 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:56:46.800845    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:56:48.077205 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:48.077174    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:48.077676 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:48.077459    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:48.078553 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:48.078535    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 20:56:54.311904 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.311867    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"]
Oct 30 20:56:54.316767 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.316750    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.328384 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.328359    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"]
Oct 30 20:56:54.406138 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.406100    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.406298 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.406212    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.406298 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.406249    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8rds\" (UniqueName: \"kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-kube-api-access-c8rds\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.406439 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.406379    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/587eaac8-4b77-4770-962f-844e6887a4ac-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.406439 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.406412    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.406567 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.406493    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.406567 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.406535    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.406659 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.406623    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/587eaac8-4b77-4770-962f-844e6887a4ac-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.406704 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.406659    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.507545 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.507507    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/587eaac8-4b77-4770-962f-844e6887a4ac-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.507545 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.507552    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.507803 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.507575    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.507803 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.507606    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.507803 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.507646    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/587eaac8-4b77-4770-962f-844e6887a4ac-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.507803 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.507679    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.507803 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.507709    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.507803 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.507796    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.508118 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.507835    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8rds\" (UniqueName: \"kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-kube-api-access-c8rds\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.508118 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.508079    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.508349 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.508324    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.508446 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.508373    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.508511 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.508498    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/587eaac8-4b77-4770-962f-844e6887a4ac-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.508568 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.508508    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.510132 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.510112    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/587eaac8-4b77-4770-962f-844e6887a4ac-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.510132 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.510119    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.521091 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.521062    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.521199 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.521175    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8rds\" (UniqueName: \"kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-kube-api-access-c8rds\") pod \"maas-default-gateway-openshift-default-58c6585447-t97cq\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.631136 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.631051    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:54.915577 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.915553    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"]
Oct 30 20:56:54.917538 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:56:54.917507    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod587eaac8_4b77_4770_962f_844e6887a4ac.slice/crio-55bd77b4610bbe6fa48160c47d3d8fac6075f768225e5fd16b6a4c35482058c7 WatchSource:0}: Error finding container 55bd77b4610bbe6fa48160c47d3d8fac6075f768225e5fd16b6a4c35482058c7: Status 404 returned error can't find the container with id 55bd77b4610bbe6fa48160c47d3d8fac6075f768225e5fd16b6a4c35482058c7
Oct 30 20:56:54.919701 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.919671    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:54.919783 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.919731    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:54.919783 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:54.919761    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:56:55.870211 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:55.870175    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" event={"ID":"587eaac8-4b77-4770-962f-844e6887a4ac","Type":"ContainerStarted","Data":"d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960"}
Oct 30 20:56:55.870608 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:55.870231    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" event={"ID":"587eaac8-4b77-4770-962f-844e6887a4ac","Type":"ContainerStarted","Data":"55bd77b4610bbe6fa48160c47d3d8fac6075f768225e5fd16b6a4c35482058c7"}
Oct 30 20:56:55.897365 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:55.897317    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" podStartSLOduration=1.897303273 podStartE2EDuration="1.897303273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:55.894928535 +0000 UTC m=+1026.753664823" watchObservedRunningTime="2026-10-30 20:56:55.897303273 +0000 UTC m=+1026.756039629"
Oct 30 20:56:56.631445 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:56.631410    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:56:56.632893 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:56.632868    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-t97cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Oct 30 20:56:56.633044 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:56.632919    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Oct 30 20:56:56.810383 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:56.810353    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-65c58bd4f6-5f68v"
Oct 30 20:56:57.632094 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:57.632058    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-t97cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Oct 30 20:56:57.632824 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:57.632120    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Oct 30 20:56:58.631646 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:58.631611    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-t97cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Oct 30 20:56:58.631823 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:58.631677    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Oct 30 20:56:59.631751 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:59.631715    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-t97cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Oct 30 20:56:59.632184 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:56:59.631779    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Oct 30 20:57:00.631957 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:00.631915    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-t97cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Oct 30 20:57:00.632473 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:00.631974    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Oct 30 20:57:01.632227 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:01.632184    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-t97cq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Oct 30 20:57:01.632746 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:01.632281    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Oct 30 20:57:03.104421 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:03.104385    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:57:03.104885 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:03.104836    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:57:03.105528 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:03.105510    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 20:57:16.800794 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:57:16.800753    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:57:25.303331 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.303293    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"]
Oct 30 20:57:25.310945 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.310921    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.320200 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.320174    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-32a969-openshift-default-dockercfg-tkmt5\""
Oct 30 20:57:25.320605 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.320583    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"]
Oct 30 20:57:25.395712 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.395681    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"]
Oct 30 20:57:25.399399 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.399379    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.421727 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.421706    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-c2d1eb-openshift-default-dockercfg-x4gzl\""
Oct 30 20:57:25.442002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.441974    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.442138 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.442035    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tstkj\" (UniqueName: \"kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-kube-api-access-tstkj\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.442191 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.442136    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/080b8378-c19b-4464-903c-a0e47a458775-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.442226 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.442187    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.442259 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.442223    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.442259 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.442245    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.442355 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.442340    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/080b8378-c19b-4464-903c-a0e47a458775-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.442393 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.442384    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.442427 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.442418    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.486281 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.486249    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"]
Oct 30 20:57:25.543406 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.543372    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.543591 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.543525    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.543591 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.543563    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85b5c\" (UniqueName: \"kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-kube-api-access-85b5c\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.543713 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.543636    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.543713 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.543679    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.543829 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.543711    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.543829 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.543737    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/080b8378-c19b-4464-903c-a0e47a458775-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.543829 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.543769    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.543829 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.543797    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.543996 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.543848    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.543996 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.543866    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.543996 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.543932    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.544165 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.544050    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.544165 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.544069    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.544165 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.544090    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.544165 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.544143    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.544394 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.544195    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.544394 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.544248    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.544394 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.544309    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.544394 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.544340    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/080b8378-c19b-4464-903c-a0e47a458775-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.544394 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.544350    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tstkj\" (UniqueName: \"kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-kube-api-access-tstkj\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.544596 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.544400    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/080b8378-c19b-4464-903c-a0e47a458775-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.544596 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.544578    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.546229 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.546198    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.546812 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.546792    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/080b8378-c19b-4464-903c-a0e47a458775-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.585306 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.585279    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tstkj\" (UniqueName: \"kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-kube-api-access-tstkj\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.590326 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.590301    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.626476 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.626451    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:25.645587 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.645556    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.645737 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.645612    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85b5c\" (UniqueName: \"kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-kube-api-access-85b5c\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.645737 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.645672    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.645737 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.645724    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.645902 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.645774    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.645902 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.645802    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.645902 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.645840    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.645902 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.645872    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.646153 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.645926    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.646360 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.646339    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.647002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.646973    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.647636 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.647615    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.648229 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.648206    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.648385 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.648356    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.650171 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.650145    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.657804 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.657783    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.674925 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.674890    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.676434 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.676407    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85b5c\" (UniqueName: \"kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-kube-api-access-85b5c\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.713036 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.712998    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:25.765953 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.765919    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"]
Oct 30 20:57:25.769926 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.769904    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.779098 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.778798    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-65968b-openshift-default-dockercfg-vzgwf\""
Oct 30 20:57:25.789182 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.789157    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"]
Oct 30 20:57:25.848179 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.848100    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp6mq\" (UniqueName: \"kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-kube-api-access-mp6mq\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.848179 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.848150    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.848363 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.848244    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.848363 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.848266    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.848363 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.848285    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81a9336f-fae4-47ca-bf38-e894ccde4f49-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.848462 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.848379    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.848462 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.848408    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.848542 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.848476    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.848542 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.848513    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.925769 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.925742    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"]
Oct 30 20:57:25.927154 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:57:25.927126    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080b8378_c19b_4464_903c_a0e47a458775.slice/crio-4a728b473b68998a6f01bb09420988fa1bf2a6706d2abe7b0e983fe269d30f4f WatchSource:0}: Error finding container 4a728b473b68998a6f01bb09420988fa1bf2a6706d2abe7b0e983fe269d30f4f: Status 404 returned error can't find the container with id 4a728b473b68998a6f01bb09420988fa1bf2a6706d2abe7b0e983fe269d30f4f
Oct 30 20:57:25.929585 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.929551    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:25.929674 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.929611    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:25.929674 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.929648    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:25.949217 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.949190    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.949323 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.949227    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.949323 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.949302    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6mq\" (UniqueName: \"kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-kube-api-access-mp6mq\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.949437 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.949340    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.949437 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.949394    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.949437 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.949425    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.949584 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.949453    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81a9336f-fae4-47ca-bf38-e894ccde4f49-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.949584 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.949494    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.949584 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.949517    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.949584 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.949526    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.949794 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.949648    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.950084 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.950014    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.950185 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.950097    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.950478 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.950452    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81a9336f-fae4-47ca-bf38-e894ccde4f49-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.951507 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.951490    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.951815 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.951799    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.961652 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.961620    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:25.961761 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:25.961744    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp6mq\" (UniqueName: \"kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-kube-api-access-mp6mq\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:26.012945 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.012912    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"]
Oct 30 20:57:26.015602 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:57:26.015570    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37eeba9_e92a_4cf2_a577_ddb2cacf4b0c.slice/crio-b2d4b3f89f1efcb8f690ee487064001c0d7009a19169e250e3d9864de2d17f54 WatchSource:0}: Error finding container b2d4b3f89f1efcb8f690ee487064001c0d7009a19169e250e3d9864de2d17f54: Status 404 returned error can't find the container with id b2d4b3f89f1efcb8f690ee487064001c0d7009a19169e250e3d9864de2d17f54
Oct 30 20:57:26.018060 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.018010    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:26.018143 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.018109    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:26.018181 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.018153    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:26.020866 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.020837    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" event={"ID":"080b8378-c19b-4464-903c-a0e47a458775","Type":"ContainerStarted","Data":"c0c2a0824e8a2803beb3e72da8258a74d05eacffd082c6228354e3fe522a6f10"}
Oct 30 20:57:26.020964 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.020895    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" event={"ID":"080b8378-c19b-4464-903c-a0e47a458775","Type":"ContainerStarted","Data":"4a728b473b68998a6f01bb09420988fa1bf2a6706d2abe7b0e983fe269d30f4f"}
Oct 30 20:57:26.096560 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.096535    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:26.380272 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.379899    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" podStartSLOduration=1.379867167 podStartE2EDuration="1.379867167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:26.05764342 +0000 UTC m=+1056.916379712" watchObservedRunningTime="2026-10-30 20:57:26.379867167 +0000 UTC m=+1057.238603457"
Oct 30 20:57:26.381640 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.381455    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"]
Oct 30 20:57:26.383791 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:57:26.383766    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a9336f_fae4_47ca_bf38_e894ccde4f49.slice/crio-1dd81b7383bd68689cbfc84994fd7e6f2d342b15b4d5ea06cd1e8f3acda7a5b3 WatchSource:0}: Error finding container 1dd81b7383bd68689cbfc84994fd7e6f2d342b15b4d5ea06cd1e8f3acda7a5b3: Status 404 returned error can't find the container with id 1dd81b7383bd68689cbfc84994fd7e6f2d342b15b4d5ea06cd1e8f3acda7a5b3
Oct 30 20:57:26.386147 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.386116    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:26.386251 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.386175    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:26.386251 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.386208    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:26.626879 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.626840    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:26.632847 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:26.632771    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:27.027918 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:27.027824    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" event={"ID":"81a9336f-fae4-47ca-bf38-e894ccde4f49","Type":"ContainerStarted","Data":"ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3"}
Oct 30 20:57:27.028081 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:27.027915    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" event={"ID":"81a9336f-fae4-47ca-bf38-e894ccde4f49","Type":"ContainerStarted","Data":"1dd81b7383bd68689cbfc84994fd7e6f2d342b15b4d5ea06cd1e8f3acda7a5b3"}
Oct 30 20:57:27.029400 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:27.029366    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" event={"ID":"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c","Type":"ContainerStarted","Data":"c197a4af0256d37021e5f5504e9aefae64828fb5f18a9426c54526d2b87df44a"}
Oct 30 20:57:27.029555 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:27.029417    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" event={"ID":"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c","Type":"ContainerStarted","Data":"b2d4b3f89f1efcb8f690ee487064001c0d7009a19169e250e3d9864de2d17f54"}
Oct 30 20:57:27.029605 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:27.029585    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:27.030499 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:27.030478    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:27.051847 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:27.051805    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" podStartSLOduration=2.051793391 podStartE2EDuration="2.051793391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:27.050647022 +0000 UTC m=+1057.909383315" watchObservedRunningTime="2026-10-30 20:57:27.051793391 +0000 UTC m=+1057.910529684"
Oct 30 20:57:27.097746 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:27.097711    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:27.100051 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:27.099980    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" podStartSLOduration=2.099964512 podStartE2EDuration="2.099964512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:27.099112793 +0000 UTC m=+1057.957849087" watchObservedRunningTime="2026-10-30 20:57:27.099964512 +0000 UTC m=+1057.958700805"
Oct 30 20:57:27.104116 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:27.104092    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:27.714091 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:27.714051    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:27.719325 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:27.719301    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:28.034701 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:28.034615    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:28.034701 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:28.034665    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:28.035220 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:28.035201    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:28.035298 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:28.035280    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:30.936420 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:30.936387    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"]
Oct 30 20:57:30.940079 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:30.940061    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"
Oct 30 20:57:30.947551 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:30.947527    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"]
Oct 30 20:57:30.949473 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:30.949455    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-5a8f94\""
Oct 30 20:57:30.951624 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:30.951608    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"
Oct 30 20:57:30.957279 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:30.957253    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"]
Oct 30 20:57:30.960321 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:30.960301    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-5a8f94-dockercfg-nk5x9\""
Oct 30 20:57:30.963383 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:30.963360    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"]
Oct 30 20:57:31.007767 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.007732    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c88mk\" (UniqueName: \"kubernetes.io/projected/b4893641-f5a3-44b3-823b-8a3c2d6fa548-kube-api-access-c88mk\") pod \"payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl\" (UID: \"b4893641-f5a3-44b3-823b-8a3c2d6fa548\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"
Oct 30 20:57:31.007986 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.007966    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4893641-f5a3-44b3-823b-8a3c2d6fa548-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl\" (UID: \"b4893641-f5a3-44b3-823b-8a3c2d6fa548\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"
Oct 30 20:57:31.108631 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.108592    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w\" (UID: \"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"
Oct 30 20:57:31.108824 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.108721    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4893641-f5a3-44b3-823b-8a3c2d6fa548-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl\" (UID: \"b4893641-f5a3-44b3-823b-8a3c2d6fa548\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"
Oct 30 20:57:31.108824 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.108751    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c88mk\" (UniqueName: \"kubernetes.io/projected/b4893641-f5a3-44b3-823b-8a3c2d6fa548-kube-api-access-c88mk\") pod \"payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl\" (UID: \"b4893641-f5a3-44b3-823b-8a3c2d6fa548\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"
Oct 30 20:57:31.108824 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.108786    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqf8d\" (UniqueName: \"kubernetes.io/projected/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-kube-api-access-jqf8d\") pod \"payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w\" (UID: \"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"
Oct 30 20:57:31.109472 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.109446    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4893641-f5a3-44b3-823b-8a3c2d6fa548-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl\" (UID: \"b4893641-f5a3-44b3-823b-8a3c2d6fa548\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"
Oct 30 20:57:31.121464 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.121444    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c88mk\" (UniqueName: \"kubernetes.io/projected/b4893641-f5a3-44b3-823b-8a3c2d6fa548-kube-api-access-c88mk\") pod \"payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl\" (UID: \"b4893641-f5a3-44b3-823b-8a3c2d6fa548\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"
Oct 30 20:57:31.210183 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.210103    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w\" (UID: \"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"
Oct 30 20:57:31.210322 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.210227    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqf8d\" (UniqueName: \"kubernetes.io/projected/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-kube-api-access-jqf8d\") pod \"payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w\" (UID: \"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"
Oct 30 20:57:31.210838 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.210817    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w\" (UID: \"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"
Oct 30 20:57:31.223653 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.223629    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqf8d\" (UniqueName: \"kubernetes.io/projected/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-kube-api-access-jqf8d\") pod \"payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w\" (UID: \"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"
Oct 30 20:57:31.255515 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.255488    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"
Oct 30 20:57:31.271193 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.271172    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"
Oct 30 20:57:31.582734 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.582702    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"]
Oct 30 20:57:31.584703 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:57:31.584678    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4893641_f5a3_44b3_823b_8a3c2d6fa548.slice/crio-46e8822009629bf92ed1a5d3b5ac4af0266c529908b96d008edf7b1de0ee545e WatchSource:0}: Error finding container 46e8822009629bf92ed1a5d3b5ac4af0266c529908b96d008edf7b1de0ee545e: Status 404 returned error can't find the container with id 46e8822009629bf92ed1a5d3b5ac4af0266c529908b96d008edf7b1de0ee545e
Oct 30 20:57:31.599494 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:31.599464    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"]
Oct 30 20:57:31.602577 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:57:31.602544    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffcfe6ad_d38d_445d_8dd3_98be89d45ac9.slice/crio-720c18ae3799218b335282b40b11007b80da73f63f3f8936f9bff51751583650 WatchSource:0}: Error finding container 720c18ae3799218b335282b40b11007b80da73f63f3f8936f9bff51751583650: Status 404 returned error can't find the container with id 720c18ae3799218b335282b40b11007b80da73f63f3f8936f9bff51751583650
Oct 30 20:57:32.056615 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.056585    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl" event={"ID":"b4893641-f5a3-44b3-823b-8a3c2d6fa548","Type":"ContainerStarted","Data":"46e8822009629bf92ed1a5d3b5ac4af0266c529908b96d008edf7b1de0ee545e"}
Oct 30 20:57:32.057857 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.057834    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w" event={"ID":"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9","Type":"ContainerStarted","Data":"720c18ae3799218b335282b40b11007b80da73f63f3f8936f9bff51751583650"}
Oct 30 20:57:32.666148 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.666113    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"]
Oct 30 20:57:32.670420 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.670395    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"
Oct 30 20:57:32.680326 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.680296    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-c2d1eb-dockercfg-29bxz\""
Oct 30 20:57:32.680466 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.680385    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-c2d1eb\""
Oct 30 20:57:32.681626 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.681608    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"]
Oct 30 20:57:32.711957 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.711919    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"]
Oct 30 20:57:32.716502 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.716476    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"
Oct 30 20:57:32.730017 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.729989    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"]
Oct 30 20:57:32.834439 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.834403    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e1a4e79-7954-407f-b9a7-fa5163bb099a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm\" (UID: \"2e1a4e79-7954-407f-b9a7-fa5163bb099a\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"
Oct 30 20:57:32.834641 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.834597    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lmcc\" (UniqueName: \"kubernetes.io/projected/2e1a4e79-7954-407f-b9a7-fa5163bb099a-kube-api-access-8lmcc\") pod \"payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm\" (UID: \"2e1a4e79-7954-407f-b9a7-fa5163bb099a\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"
Oct 30 20:57:32.834691 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.834649    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qksxp\" (UniqueName: \"kubernetes.io/projected/bb223380-c1c3-4a02-8cc0-5021e8d258af-kube-api-access-qksxp\") pod \"payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm\" (UID: \"bb223380-c1c3-4a02-8cc0-5021e8d258af\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"
Oct 30 20:57:32.834691 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.834678    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb223380-c1c3-4a02-8cc0-5021e8d258af-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm\" (UID: \"bb223380-c1c3-4a02-8cc0-5021e8d258af\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"
Oct 30 20:57:32.936439 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.936323    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lmcc\" (UniqueName: \"kubernetes.io/projected/2e1a4e79-7954-407f-b9a7-fa5163bb099a-kube-api-access-8lmcc\") pod \"payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm\" (UID: \"2e1a4e79-7954-407f-b9a7-fa5163bb099a\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"
Oct 30 20:57:32.936439 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.936426    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qksxp\" (UniqueName: \"kubernetes.io/projected/bb223380-c1c3-4a02-8cc0-5021e8d258af-kube-api-access-qksxp\") pod \"payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm\" (UID: \"bb223380-c1c3-4a02-8cc0-5021e8d258af\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"
Oct 30 20:57:32.936657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.936471    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb223380-c1c3-4a02-8cc0-5021e8d258af-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm\" (UID: \"bb223380-c1c3-4a02-8cc0-5021e8d258af\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"
Oct 30 20:57:32.936657 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.936564    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e1a4e79-7954-407f-b9a7-fa5163bb099a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm\" (UID: \"2e1a4e79-7954-407f-b9a7-fa5163bb099a\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"
Oct 30 20:57:32.937682 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.937653    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e1a4e79-7954-407f-b9a7-fa5163bb099a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm\" (UID: \"2e1a4e79-7954-407f-b9a7-fa5163bb099a\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"
Oct 30 20:57:32.938713 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.938683    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb223380-c1c3-4a02-8cc0-5021e8d258af-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm\" (UID: \"bb223380-c1c3-4a02-8cc0-5021e8d258af\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"
Oct 30 20:57:32.964816 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.964792    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qksxp\" (UniqueName: \"kubernetes.io/projected/bb223380-c1c3-4a02-8cc0-5021e8d258af-kube-api-access-qksxp\") pod \"payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm\" (UID: \"bb223380-c1c3-4a02-8cc0-5021e8d258af\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"
Oct 30 20:57:32.996234 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.996198    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"
Oct 30 20:57:32.998644 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:32.998541    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lmcc\" (UniqueName: \"kubernetes.io/projected/2e1a4e79-7954-407f-b9a7-fa5163bb099a-kube-api-access-8lmcc\") pod \"payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm\" (UID: \"2e1a4e79-7954-407f-b9a7-fa5163bb099a\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"
Oct 30 20:57:33.034655 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.034478    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"
Oct 30 20:57:33.302180 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.302099    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"]
Oct 30 20:57:33.313680 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:57:33.313649    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb223380_c1c3_4a02_8cc0_5021e8d258af.slice/crio-f9daf6a3fe34d089bf3956f466c3701bf98936d7f455892fe3ba6c51b576cf21 WatchSource:0}: Error finding container f9daf6a3fe34d089bf3956f466c3701bf98936d7f455892fe3ba6c51b576cf21: Status 404 returned error can't find the container with id f9daf6a3fe34d089bf3956f466c3701bf98936d7f455892fe3ba6c51b576cf21
Oct 30 20:57:33.360158 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.359798    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"]
Oct 30 20:57:33.363443 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:57:33.363385    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1a4e79_7954_407f_b9a7_fa5163bb099a.slice/crio-6cb7d17dad6ef31f1e1d863a8b4c9c0937f89631e4cd5e4fd8efd4a7b21975e8 WatchSource:0}: Error finding container 6cb7d17dad6ef31f1e1d863a8b4c9c0937f89631e4cd5e4fd8efd4a7b21975e8: Status 404 returned error can't find the container with id 6cb7d17dad6ef31f1e1d863a8b4c9c0937f89631e4cd5e4fd8efd4a7b21975e8
Oct 30 20:57:33.695120 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.695084    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"]
Oct 30 20:57:33.710286 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.710261    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"
Oct 30 20:57:33.729394 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.729355    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"]
Oct 30 20:57:33.749509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.749455    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-39fb96\""
Oct 30 20:57:33.853497 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.853414    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx\" (UID: \"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"
Oct 30 20:57:33.853667 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.853611    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwz6n\" (UniqueName: \"kubernetes.io/projected/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-kube-api-access-rwz6n\") pod \"payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx\" (UID: \"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"
Oct 30 20:57:33.955450 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.954809    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwz6n\" (UniqueName: \"kubernetes.io/projected/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-kube-api-access-rwz6n\") pod \"payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx\" (UID: \"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"
Oct 30 20:57:33.955450 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.954946    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx\" (UID: \"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"
Oct 30 20:57:33.956660 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.956624    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx\" (UID: \"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"
Oct 30 20:57:33.976053 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:33.975717    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwz6n\" (UniqueName: \"kubernetes.io/projected/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-kube-api-access-rwz6n\") pod \"payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx\" (UID: \"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"
Oct 30 20:57:34.031713 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:34.031680    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"
Oct 30 20:57:34.084584 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:34.084491    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm" event={"ID":"2e1a4e79-7954-407f-b9a7-fa5163bb099a","Type":"ContainerStarted","Data":"6cb7d17dad6ef31f1e1d863a8b4c9c0937f89631e4cd5e4fd8efd4a7b21975e8"}
Oct 30 20:57:34.089980 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:34.089942    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm" event={"ID":"bb223380-c1c3-4a02-8cc0-5021e8d258af","Type":"ContainerStarted","Data":"f9daf6a3fe34d089bf3956f466c3701bf98936d7f455892fe3ba6c51b576cf21"}
Oct 30 20:57:34.388507 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:34.388426    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"]
Oct 30 20:57:34.396312 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:57:34.396269    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2b1bb4_d4c9_408d_ac24_6510b420b4dd.slice/crio-6d28cb7049d765bdecacfc17ae05401e6487b1976ed9dbaf1d1b01f758ded2a3 WatchSource:0}: Error finding container 6d28cb7049d765bdecacfc17ae05401e6487b1976ed9dbaf1d1b01f758ded2a3: Status 404 returned error can't find the container with id 6d28cb7049d765bdecacfc17ae05401e6487b1976ed9dbaf1d1b01f758ded2a3
Oct 30 20:57:35.098833 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:35.098726    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx" event={"ID":"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd","Type":"ContainerStarted","Data":"c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0"}
Oct 30 20:57:35.098833 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:35.098809    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx" event={"ID":"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd","Type":"ContainerStarted","Data":"6d28cb7049d765bdecacfc17ae05401e6487b1976ed9dbaf1d1b01f758ded2a3"}
Oct 30 20:57:35.099068 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:35.098976    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"
Oct 30 20:57:35.101843 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:35.101817    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl" event={"ID":"b4893641-f5a3-44b3-823b-8a3c2d6fa548","Type":"ContainerStarted","Data":"840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e"}
Oct 30 20:57:35.101989 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:35.101883    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"
Oct 30 20:57:35.105893 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:35.105869    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w" event={"ID":"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9","Type":"ContainerStarted","Data":"04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d"}
Oct 30 20:57:35.106011 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:35.105941    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"
Oct 30 20:57:35.120136 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:35.120082    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx" podStartSLOduration=1.681105117 podStartE2EDuration="2.120065301s" totalImagesPullingTime="438.960184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:35.117278252 +0000 UTC m=+1065.976014546" watchObservedRunningTime="2026-10-30 20:57:35.120065301 +0000 UTC m=+1065.978801597"
Oct 30 20:57:35.145289 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:35.145243    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl" podStartSLOduration=1.893809407 podStartE2EDuration="5.145230868s" totalImagesPullingTime="3.251421461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:35.143042554 +0000 UTC m=+1066.001778845" watchObservedRunningTime="2026-10-30 20:57:35.145230868 +0000 UTC m=+1066.003967161"
Oct 30 20:57:35.166017 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:35.165969    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w" podStartSLOduration=1.84503302 podStartE2EDuration="5.165953439s" totalImagesPullingTime="3.320920419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:35.163808429 +0000 UTC m=+1066.022544723" watchObservedRunningTime="2026-10-30 20:57:35.165953439 +0000 UTC m=+1066.024689782"
Oct 30 20:57:36.119586 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:36.119543    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm" event={"ID":"bb223380-c1c3-4a02-8cc0-5021e8d258af","Type":"ContainerStarted","Data":"6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e"}
Oct 30 20:57:36.120498 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:36.120465    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"
Oct 30 20:57:36.122588 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:36.122565    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm" event={"ID":"2e1a4e79-7954-407f-b9a7-fa5163bb099a","Type":"ContainerStarted","Data":"e7c5ad01d5886da4a967611c861ffcec739688cfe25ee32a429d3e1d0eff36fe"}
Oct 30 20:57:36.123272 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:36.122816    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"
Oct 30 20:57:36.143796 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:36.143739    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm" podStartSLOduration=2.276668112 podStartE2EDuration="4.143720086s" totalImagesPullingTime="1.867051974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:36.141038876 +0000 UTC m=+1066.999775170" watchObservedRunningTime="2026-10-30 20:57:36.143720086 +0000 UTC m=+1067.002456379"
Oct 30 20:57:36.163393 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:36.163329    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm" podStartSLOduration=2.304106907 podStartE2EDuration="4.163313705s" totalImagesPullingTime="1.859206798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:36.160634248 +0000 UTC m=+1067.019370543" watchObservedRunningTime="2026-10-30 20:57:36.163313705 +0000 UTC m=+1067.022050089"
Oct 30 20:57:37.468157 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.468119    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"]
Oct 30 20:57:37.480329 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.480299    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:37.486293 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.486263    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"]
Oct 30 20:57:37.488578 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.488496    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 20:57:37.488578 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.488557    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-32a969-serving-cert\""
Oct 30 20:57:37.488760 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.488584    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 20:57:37.488760 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.488689    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-57jm5\""
Oct 30 20:57:37.490143 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.490114    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 20:57:37.512297 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.512252    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a99f6390-6609-4125-bac3-2e347b8fa7bf-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:37.512297 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.512299    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9qpn\" (UniqueName: \"kubernetes.io/projected/a99f6390-6609-4125-bac3-2e347b8fa7bf-kube-api-access-h9qpn\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:37.512475 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.512375    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-metrics-certs\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:37.512533 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.512518    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-maas-api-tls\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:37.613498 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.613455    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a99f6390-6609-4125-bac3-2e347b8fa7bf-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:37.613498 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.613493    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9qpn\" (UniqueName: \"kubernetes.io/projected/a99f6390-6609-4125-bac3-2e347b8fa7bf-kube-api-access-h9qpn\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:37.613745 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.613521    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-metrics-certs\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:37.613745 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.613619    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-maas-api-tls\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:37.613816 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:57:37.613798    6048 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-serving-cert: secret "maas-api-e2e-worker-w2-32a969-serving-cert" not found
Oct 30 20:57:37.613884 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:57:37.613870    6048 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-maas-api-tls podName:a99f6390-6609-4125-bac3-2e347b8fa7bf nodeName:}" failed. No retries permitted until 2026-10-30 20:57:38.113847485 +0000 UTC m=+1068.972583777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-maas-api-tls") pod "maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt" (UID: "a99f6390-6609-4125-bac3-2e347b8fa7bf") : secret "maas-api-e2e-worker-w2-32a969-serving-cert" not found
Oct 30 20:57:37.614357 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.614325    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a99f6390-6609-4125-bac3-2e347b8fa7bf-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:37.617103 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.617076    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-metrics-certs\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:37.637326 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:37.635960    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9qpn\" (UniqueName: \"kubernetes.io/projected/a99f6390-6609-4125-bac3-2e347b8fa7bf-kube-api-access-h9qpn\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:38.118866 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:38.118836    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-maas-api-tls\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:38.121354 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:38.121330    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-maas-api-tls\") pod \"maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:38.399665 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:38.399576    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:38.677512 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:38.677486    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"]
Oct 30 20:57:38.679390 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:57:38.679360    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda99f6390_6609_4125_bac3_2e347b8fa7bf.slice/crio-32af6a963e6c5ccda0a1156605fcd130b41ce9d9f6cfb548dcfe22ae874e3f5c WatchSource:0}: Error finding container 32af6a963e6c5ccda0a1156605fcd130b41ce9d9f6cfb548dcfe22ae874e3f5c: Status 404 returned error can't find the container with id 32af6a963e6c5ccda0a1156605fcd130b41ce9d9f6cfb548dcfe22ae874e3f5c
Oct 30 20:57:39.139081 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:39.139047    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt" event={"ID":"a99f6390-6609-4125-bac3-2e347b8fa7bf","Type":"ContainerStarted","Data":"32af6a963e6c5ccda0a1156605fcd130b41ce9d9f6cfb548dcfe22ae874e3f5c"}
Oct 30 20:57:41.171483 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.171446    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt" event={"ID":"a99f6390-6609-4125-bac3-2e347b8fa7bf","Type":"ContainerStarted","Data":"b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf"}
Oct 30 20:57:41.171894 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.171551    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:41.193613 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.193561    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt" podStartSLOduration=2.396730191 podStartE2EDuration="4.19354776s" totalImagesPullingTime="1.796817569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:41.191893778 +0000 UTC m=+1072.050630070" watchObservedRunningTime="2026-10-30 20:57:41.19354776 +0000 UTC m=+1072.052284052"
Oct 30 20:57:41.281380 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.281342    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"]
Oct 30 20:57:41.285343 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.285296    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"]
Oct 30 20:57:41.285343 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.285407    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.291160 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.291137    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-c2d1eb-serving-cert\""
Oct 30 20:57:41.376397 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.376363    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-metrics-certs\") pod \"maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.376601 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.376510    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-maas-api-tls\") pod \"maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.376601 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.376560    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5mrn\" (UniqueName: \"kubernetes.io/projected/ea40cb7a-b1a7-480d-99b8-88c825bc3448-kube-api-access-t5mrn\") pod \"maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.376743 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.376603    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea40cb7a-b1a7-480d-99b8-88c825bc3448-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.478217 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.478122    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-metrics-certs\") pod \"maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.478217 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.478192    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-maas-api-tls\") pod \"maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.478475 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.478228    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5mrn\" (UniqueName: \"kubernetes.io/projected/ea40cb7a-b1a7-480d-99b8-88c825bc3448-kube-api-access-t5mrn\") pod \"maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.478475 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.478254    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea40cb7a-b1a7-480d-99b8-88c825bc3448-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.478935 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.478909    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea40cb7a-b1a7-480d-99b8-88c825bc3448-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.480792 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.480763    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-metrics-certs\") pod \"maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.480899 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.480773    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-maas-api-tls\") pod \"maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.491232 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.491211    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5mrn\" (UniqueName: \"kubernetes.io/projected/ea40cb7a-b1a7-480d-99b8-88c825bc3448-kube-api-access-t5mrn\") pod \"maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.599289 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.599248    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:41.910569 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:41.910543    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"]
Oct 30 20:57:42.178474 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:42.178382    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4" event={"ID":"ea40cb7a-b1a7-480d-99b8-88c825bc3448","Type":"ContainerStarted","Data":"9a2462fd765848a11dbcf68b050bbbeef10b9c9e38fe4804aa92507774555815"}
Oct 30 20:57:43.185253 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:43.185215    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4" event={"ID":"ea40cb7a-b1a7-480d-99b8-88c825bc3448","Type":"ContainerStarted","Data":"0b9d7c801b35b64be968e521e7b0b5884fdca5ba568317d66834776a12339ff7"}
Oct 30 20:57:43.185660 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:43.185402    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:43.208695 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:43.208653    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4" podStartSLOduration=1.631908438 podStartE2EDuration="2.208641609s" totalImagesPullingTime="576.733171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:43.208340025 +0000 UTC m=+1074.067076319" watchObservedRunningTime="2026-10-30 20:57:43.208641609 +0000 UTC m=+1074.067377901"
Oct 30 20:57:46.126615 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:46.126586    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"
Oct 30 20:57:46.127385 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:46.126665    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"
Oct 30 20:57:46.127385 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:46.126804    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"
Oct 30 20:57:46.817051 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:57:46.816998    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:57:47.130844 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:47.130813    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"
Oct 30 20:57:47.203158 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:47.202091    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 20:57:48.138154 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:48.138120    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"
Oct 30 20:57:49.198327 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:49.198298    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 20:57:50.735745 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.735713    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"]
Oct 30 20:57:50.741106 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.741088    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.766856 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.766391    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-4a0c5b\"/\"openshift-service-ca.crt\""
Oct 30 20:57:50.766856 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.766516    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-4a0c5b\"/\"kube-root-ca.crt\""
Oct 30 20:57:50.771469 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.771319    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-4a0c5b\"/\"default-dockercfg-46tcm\""
Oct 30 20:57:50.771469 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.771436    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-4a0c5b\"/\"simulator-w0-4a0c5b-kserve-self-signed-certs\""
Oct 30 20:57:50.799799 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.799752    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"]
Oct 30 20:57:50.841141 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.840623    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-tmp-dir\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.841141 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.840687    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s72wk\" (UniqueName: \"kubernetes.io/projected/727e1989-a102-468c-af84-a86c761a4135-kube-api-access-s72wk\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.841141 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.840787    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-dshm\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.841141 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.840809    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/727e1989-a102-468c-af84-a86c761a4135-tls-certs\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.841141 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.840838    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-home\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.841141 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.840962    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-model-cache\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.950075 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.949696    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-model-cache\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.950075 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.949759    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-tmp-dir\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.950075 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.949807    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s72wk\" (UniqueName: \"kubernetes.io/projected/727e1989-a102-468c-af84-a86c761a4135-kube-api-access-s72wk\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.950075 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.949903    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-dshm\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.950075 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.949928    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/727e1989-a102-468c-af84-a86c761a4135-tls-certs\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.950075 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.949958    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-home\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.950833 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.950461    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-home\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.950833 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.950710    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-model-cache\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.963059 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.950948    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-tmp-dir\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.976753 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.976677    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/727e1989-a102-468c-af84-a86c761a4135-tls-certs\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.977278 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.977226    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-dshm\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:50.990951 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:50.990859    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s72wk\" (UniqueName: \"kubernetes.io/projected/727e1989-a102-468c-af84-a86c761a4135-kube-api-access-s72wk\") pod \"simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") " pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:51.102287 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:51.102248    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:51.473067 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:51.464303    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"]
Oct 30 20:57:52.308098 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:52.308056    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" event={"ID":"727e1989-a102-468c-af84-a86c761a4135","Type":"ContainerStarted","Data":"6c8e0bb30d757a1cf88a0b0ccb0aafdd2438f59ab646b713a5819f365cdad763"}
Oct 30 20:57:52.308560 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:52.308111    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" event={"ID":"727e1989-a102-468c-af84-a86c761a4135","Type":"ContainerStarted","Data":"e2eda5a7855838c780aff16ea91df26192bcee1c8d808905010d934b05925920"}
Oct 30 20:57:52.352998 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:52.352939    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podStartSLOduration=2.352922952 podStartE2EDuration="2.352922952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:52.35197495 +0000 UTC m=+1083.210711244" watchObservedRunningTime="2026-10-30 20:57:52.352922952 +0000 UTC m=+1083.211659245"
Oct 30 20:57:53.103258 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:53.103206    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:57:53.315608 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:53.315557    6048 generic.go:356] "Generic (PLEG): container finished" podID="080b8378-c19b-4464-903c-a0e47a458775" containerID="c0c2a0824e8a2803beb3e72da8258a74d05eacffd082c6228354e3fe522a6f10" exitCode=0
Oct 30 20:57:53.316071 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:53.315620    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" event={"ID":"080b8378-c19b-4464-903c-a0e47a458775","Type":"ContainerDied","Data":"c0c2a0824e8a2803beb3e72da8258a74d05eacffd082c6228354e3fe522a6f10"}
Oct 30 20:57:53.316162 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:53.316120    6048 scope.go:122] "RemoveContainer" containerID="c0c2a0824e8a2803beb3e72da8258a74d05eacffd082c6228354e3fe522a6f10"
Oct 30 20:57:53.317839 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:53.317801    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:53.317932 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:53.317903    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:53.317974 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:53.317957    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:54.335968 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:54.335907    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" event={"ID":"080b8378-c19b-4464-903c-a0e47a458775","Type":"ContainerStarted","Data":"db23576516fd94510277a6e707cc79e607e8b6363395c87c4a347cefd4022d26"}
Oct 30 20:57:54.627387 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:54.627311    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:54.628688 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:54.628661    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Oct 30 20:57:54.628814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:54.628711    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Oct 30 20:57:55.627102 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:55.626992    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Oct 30 20:57:55.627102 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:55.627085    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Oct 30 20:57:56.381464 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.381429    6048 generic.go:356] "Generic (PLEG): container finished" podID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerID="ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3" exitCode=0
Oct 30 20:57:56.381687 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.381498    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" event={"ID":"81a9336f-fae4-47ca-bf38-e894ccde4f49","Type":"ContainerDied","Data":"ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3"}
Oct 30 20:57:56.381918 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.381900    6048 scope.go:122] "RemoveContainer" containerID="ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3"
Oct 30 20:57:56.383479 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.383449    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:56.383588 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.383528    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:56.383588 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.383567    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:56.386513 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.383956    6048 generic.go:356] "Generic (PLEG): container finished" podID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerID="c197a4af0256d37021e5f5504e9aefae64828fb5f18a9426c54526d2b87df44a" exitCode=0
Oct 30 20:57:56.386513 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.383994    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" event={"ID":"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c","Type":"ContainerDied","Data":"c197a4af0256d37021e5f5504e9aefae64828fb5f18a9426c54526d2b87df44a"}
Oct 30 20:57:56.386513 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.384368    6048 scope.go:122] "RemoveContainer" containerID="c197a4af0256d37021e5f5504e9aefae64828fb5f18a9426c54526d2b87df44a"
Oct 30 20:57:56.387646 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.387622    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:56.387802 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.387788    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:56.387884 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.387873    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:57:56.628609 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.628440    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Oct 30 20:57:56.628609 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:56.628503    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Oct 30 20:57:57.030251 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:57.030216    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:57:57.397129 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:57.397078    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" event={"ID":"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c","Type":"ContainerStarted","Data":"9259521c28baf4e7db0ebb0e05716311985a47a80a5250ce27ac6c6ac962a790"}
Oct 30 20:57:57.405123 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:57.405080    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" event={"ID":"81a9336f-fae4-47ca-bf38-e894ccde4f49","Type":"ContainerStarted","Data":"94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519"}
Oct 30 20:57:57.627557 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:57.627524    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Oct 30 20:57:57.627785 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:57.627764    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Oct 30 20:57:57.718108 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:57.717542    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:57.721782 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:57.721441    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Oct 30 20:57:57.721782 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:57.721504    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Oct 30 20:57:58.034857 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:58.034649    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:57:58.034857 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:58.034734    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:58.098804 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:58.098333    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:57:58.098804 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:58.098464    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Oct 30 20:57:58.098804 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:58.098507    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Oct 30 20:57:58.627870 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:58.627510    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Oct 30 20:57:58.627870 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:58.627561    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Oct 30 20:57:58.726048 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:58.718417    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Oct 30 20:57:58.726048 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:58.718484    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Oct 30 20:57:59.098042 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:59.097516    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Oct 30 20:57:59.098042 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:59.097615    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Oct 30 20:57:59.628133 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:59.627336    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Oct 30 20:57:59.628133 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:59.627409    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Oct 30 20:57:59.715324 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:59.715284    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Oct 30 20:57:59.715503 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:57:59.715355    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Oct 30 20:58:00.097611 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:00.097578    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Oct 30 20:58:00.098119 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:00.098092    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Oct 30 20:58:00.632243 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:00.632211    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:58:00.633328 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:00.633306    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 20:58:00.719410 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:00.719368    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Oct 30 20:58:00.719603 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:00.719445    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Oct 30 20:58:01.097381 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:01.097341    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Oct 30 20:58:01.097898 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:01.097862    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Oct 30 20:58:01.107856 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:01.107823    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:58:01.126566 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:01.126543    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:58:01.508148 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:01.508063    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 20:58:01.713951 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:01.713917    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Oct 30 20:58:01.714197 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:01.714017    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Oct 30 20:58:02.097587 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:02.097548    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Oct 30 20:58:02.097781 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:02.097602    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Oct 30 20:58:02.714643 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:02.714605    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Oct 30 20:58:02.715057 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:02.714672    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Oct 30 20:58:03.097763 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:03.097728    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Oct 30 20:58:03.097966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:03.097785    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Oct 30 20:58:03.718885 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:03.718856    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:58:03.719930 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:03.719910    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 20:58:04.101897 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:04.101872    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:58:04.102801 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:04.102779    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 20:58:06.956341 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:06.956307    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"]
Oct 30 20:58:06.960245 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:06.960222    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:06.970509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:06.970487    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-65968b\"/\"kube-root-ca.crt\""
Oct 30 20:58:06.971370 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:06.970633    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-65968b\"/\"openshift-service-ca.crt\""
Oct 30 20:58:06.972302 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:06.972281    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-65968b\"/\"default-dockercfg-xrc8s\""
Oct 30 20:58:06.972491 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:06.972465    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-65968b\"/\"simulator-w5-65968b-kserve-self-signed-certs\""
Oct 30 20:58:06.974313 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:06.974290    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"]
Oct 30 20:58:07.084086 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.073813    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-dshm\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.084086 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.073914    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw6cn\" (UniqueName: \"kubernetes.io/projected/eebd051e-6e84-4e36-9ae7-c14239aae8e3-kube-api-access-dw6cn\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.084086 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.073979    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tls-certs\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.084086 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.074077    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-home\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.084086 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.074102    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tmp-dir\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.084086 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.074185    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-model-cache\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.179381 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.179336    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-home\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.179653 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.179634    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tmp-dir\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.179832 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.179818    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-model-cache\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.179985 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.179969    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-dshm\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.180163 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.180136    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw6cn\" (UniqueName: \"kubernetes.io/projected/eebd051e-6e84-4e36-9ae7-c14239aae8e3-kube-api-access-dw6cn\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.180306 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.180292    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tls-certs\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.181347 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.181320    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-model-cache\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.188260 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.188235    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-home\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.188698 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.188670    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tmp-dir\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.206508 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.206442    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tls-certs\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.222348 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.222315    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-dshm\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.227814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.227768    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw6cn\" (UniqueName: \"kubernetes.io/projected/eebd051e-6e84-4e36-9ae7-c14239aae8e3-kube-api-access-dw6cn\") pod \"simulator-w5-65968b-kserve-55d44dd88-jbsbb\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") " pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.274176 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.274132    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:07.552887 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:07.552859    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"]
Oct 30 20:58:07.554951 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:58:07.554922    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeebd051e_6e84_4e36_9ae7_c14239aae8e3.slice/crio-c787a7b0e55632c99be04f37514455e7a38353aeccd0bce5aca2b660bbf9e5dd WatchSource:0}: Error finding container c787a7b0e55632c99be04f37514455e7a38353aeccd0bce5aca2b660bbf9e5dd: Status 404 returned error can't find the container with id c787a7b0e55632c99be04f37514455e7a38353aeccd0bce5aca2b660bbf9e5dd
Oct 30 20:58:08.298051 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.298005    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"]
Oct 30 20:58:08.301999 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.301971    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.312636 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.312604    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c2d1eb\"/\"openshift-service-ca.crt\""
Oct 30 20:58:08.312799 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.312754    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c2d1eb\"/\"kube-root-ca.crt\""
Oct 30 20:58:08.316127 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.316105    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"]
Oct 30 20:58:08.318278 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.318253    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c2d1eb\"/\"default-dockercfg-mhxkm\""
Oct 30 20:58:08.318490 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.318271    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c2d1eb\"/\"simulator-w4-c2d1eb-kserve-self-signed-certs\""
Oct 30 20:58:08.395436 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.395398    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-home\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.395436 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.395441    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-dshm\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.395651 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.395527    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-tmp-dir\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.395651 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.395582    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-model-cache\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.395651 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.395616    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jxzw\" (UniqueName: \"kubernetes.io/projected/97c16fe5-4533-4461-b707-875be418fce3-kube-api-access-5jxzw\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.395748 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.395677    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97c16fe5-4533-4461-b707-875be418fce3-tls-certs\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.496825 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.496780    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97c16fe5-4533-4461-b707-875be418fce3-tls-certs\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.497014 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.496998    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-home\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.497089 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.497040    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-dshm\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.497089 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.497073    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-tmp-dir\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.497211 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.497106    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-model-cache\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.497211 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.497160    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jxzw\" (UniqueName: \"kubernetes.io/projected/97c16fe5-4533-4461-b707-875be418fce3-kube-api-access-5jxzw\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.497512 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.497458    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-home\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.497640 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.497574    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-model-cache\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.497725 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.497701    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-tmp-dir\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.499649 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.499622    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-dshm\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.499883 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.499861    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97c16fe5-4533-4461-b707-875be418fce3-tls-certs\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.507060 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.507017    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" event={"ID":"eebd051e-6e84-4e36-9ae7-c14239aae8e3","Type":"ContainerStarted","Data":"ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36"}
Oct 30 20:58:08.507234 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.507075    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" event={"ID":"eebd051e-6e84-4e36-9ae7-c14239aae8e3","Type":"ContainerStarted","Data":"c787a7b0e55632c99be04f37514455e7a38353aeccd0bce5aca2b660bbf9e5dd"}
Oct 30 20:58:08.510382 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.510358    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jxzw\" (UniqueName: \"kubernetes.io/projected/97c16fe5-4533-4461-b707-875be418fce3-kube-api-access-5jxzw\") pod \"simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") " pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.528007 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.527961    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podStartSLOduration=2.527940231 podStartE2EDuration="2.527940231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:08.526231284 +0000 UTC m=+1099.384967578" watchObservedRunningTime="2026-10-30 20:58:08.527940231 +0000 UTC m=+1099.386676521"
Oct 30 20:58:08.615486 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.615441    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:08.913747 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:08.913718    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"]
Oct 30 20:58:08.916626 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:58:08.916591    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97c16fe5_4533_4461_b707_875be418fce3.slice/crio-03a1570914c3ddcf2dec01fc2378dc9fbe1b17d3dfc47a4def55923731ad9b42 WatchSource:0}: Error finding container 03a1570914c3ddcf2dec01fc2378dc9fbe1b17d3dfc47a4def55923731ad9b42: Status 404 returned error can't find the container with id 03a1570914c3ddcf2dec01fc2378dc9fbe1b17d3dfc47a4def55923731ad9b42
Oct 30 20:58:09.274330 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:09.274253    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:09.513939 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:09.513898    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" event={"ID":"97c16fe5-4533-4461-b707-875be418fce3","Type":"ContainerStarted","Data":"021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2"}
Oct 30 20:58:09.514361 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:09.513949    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" event={"ID":"97c16fe5-4533-4461-b707-875be418fce3","Type":"ContainerStarted","Data":"03a1570914c3ddcf2dec01fc2378dc9fbe1b17d3dfc47a4def55923731ad9b42"}
Oct 30 20:58:09.535894 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:09.535791    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podStartSLOduration=1.5357782599999998 podStartE2EDuration="1.53577826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:09.533599971 +0000 UTC m=+1100.392336265" watchObservedRunningTime="2026-10-30 20:58:09.53577826 +0000 UTC m=+1100.394514553"
Oct 30 20:58:09.615518 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:09.615488    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:16.805176 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:58:16.805138    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:58:17.275349 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:17.275316    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:17.288007 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:17.287974    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:17.574419 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:17.574385    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 20:58:18.616585 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:18.616541    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:18.629446 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:18.629416    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:19.581687 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:19.581658    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 20:58:20.051753 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.051656    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"]
Oct 30 20:58:20.059980 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.059940    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.061951 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.061928    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"]
Oct 30 20:58:20.068554 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.068527    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-32a969\"/\"default-dockercfg-6s24m\""
Oct 30 20:58:20.069645 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.069626    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-32a969\"/\"openshift-service-ca.crt\""
Oct 30 20:58:20.069729 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.069710    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-32a969\"/\"premium-w2-32a969-kserve-self-signed-certs\""
Oct 30 20:58:20.069777 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.069747    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-32a969\"/\"kube-root-ca.crt\""
Oct 30 20:58:20.139471 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.139433    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlds2\" (UniqueName: \"kubernetes.io/projected/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-kube-api-access-wlds2\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.139645 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.139483    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tmp-dir\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.139704 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.139678    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-home\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.139741 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.139729    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-dshm\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.139814 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.139802    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-model-cache\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.139852 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.139841    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tls-certs\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.241239 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.241201    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tls-certs\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.241443 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.241265    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlds2\" (UniqueName: \"kubernetes.io/projected/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-kube-api-access-wlds2\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.241443 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.241304    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tmp-dir\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.241443 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.241408    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-home\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.241443 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.241437    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-dshm\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.241668 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.241458    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-model-cache\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.241838 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.241813    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-home\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.241918 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.241864    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tmp-dir\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.241918 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.241875    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-model-cache\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.243627 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.243603    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-dshm\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.243801 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.243782    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tls-certs\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.252933 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.252912    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlds2\" (UniqueName: \"kubernetes.io/projected/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-kube-api-access-wlds2\") pod \"premium-w2-32a969-kserve-c6ccdb5b6-bl8tm\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") " pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.375086 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.375050    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:20.652162 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:20.652136    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"]
Oct 30 20:58:20.653836 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:58:20.653803    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bc9653c_9d66_4407_aa8d_f3109feaa0d9.slice/crio-c0d15b235ce534f79f6f827ead6e2f5e083b326ee3677cfecb1c2cd7d3dff4f9 WatchSource:0}: Error finding container c0d15b235ce534f79f6f827ead6e2f5e083b326ee3677cfecb1c2cd7d3dff4f9: Status 404 returned error can't find the container with id c0d15b235ce534f79f6f827ead6e2f5e083b326ee3677cfecb1c2cd7d3dff4f9
Oct 30 20:58:21.582458 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:21.582422    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" event={"ID":"5bc9653c-9d66-4407-aa8d-f3109feaa0d9","Type":"ContainerStarted","Data":"ee7a5146537aa6c666391a0aaa9d23007bf93e6cbc230b104aae8b920db29002"}
Oct 30 20:58:21.582842 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:21.582468    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" event={"ID":"5bc9653c-9d66-4407-aa8d-f3109feaa0d9","Type":"ContainerStarted","Data":"c0d15b235ce534f79f6f827ead6e2f5e083b326ee3677cfecb1c2cd7d3dff4f9"}
Oct 30 20:58:21.618687 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:21.618635    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podStartSLOduration=1.6186198429999998 podStartE2EDuration="1.618619843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:21.616968668 +0000 UTC m=+1112.475704961" watchObservedRunningTime="2026-10-30 20:58:21.618619843 +0000 UTC m=+1112.477356135"
Oct 30 20:58:22.375506 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:22.375470    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:30.376227 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:30.376187    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:30.389049 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:30.388998    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:30.658936 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:30.658859    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 20:58:40.305149 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.305112    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"]
Oct 30 20:58:40.308985 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.308964    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.313380 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.313354    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-4a0c5b-openshift-default-dockercfg-ngx6w\""
Oct 30 20:58:40.324166 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.324136    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"]
Oct 30 20:58:40.382477 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.382438    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7pkn\" (UniqueName: \"kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-kube-api-access-h7pkn\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.382642 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.382491    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.382642 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.382511    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.382715 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.382660    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.382749 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.382712    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9703dc85-1cd0-44c8-881a-1a84c54961ad-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.382834 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.382809    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.382902 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.382886    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.382937 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.382929    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.382969 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.382953    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484146 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484108    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484338 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484163    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484338 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484199    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484338 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484243    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7pkn\" (UniqueName: \"kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-kube-api-access-h7pkn\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484338 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484294    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484338 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484316    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484604 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484415    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484604 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484473    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9703dc85-1cd0-44c8-881a-1a84c54961ad-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484604 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484524    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484752 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484685    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484806 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484789    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484861 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484809    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.484919 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.484884    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.485290 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.485266    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9703dc85-1cd0-44c8-881a-1a84c54961ad-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.486470 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.486451    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.487063 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.487041    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.496613 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.496582    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.496822 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.496795    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7pkn\" (UniqueName: \"kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-kube-api-access-h7pkn\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.622731 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.622694    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:40.912941 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.912901    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"]
Oct 30 20:58:40.914928 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:58:40.914900    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9703dc85_1cd0_44c8_881a_1a84c54961ad.slice/crio-181ded720d05ff23291ecfd4046a7092578e4b8f0b75b6ab26c923ecbfebca9f WatchSource:0}: Error finding container 181ded720d05ff23291ecfd4046a7092578e4b8f0b75b6ab26c923ecbfebca9f: Status 404 returned error can't find the container with id 181ded720d05ff23291ecfd4046a7092578e4b8f0b75b6ab26c923ecbfebca9f
Oct 30 20:58:40.918343 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.918313    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:58:40.918419 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.918376    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:58:40.918419 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:40.918402    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:58:41.725984 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:41.725946    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" event={"ID":"9703dc85-1cd0-44c8-881a-1a84c54961ad","Type":"ContainerStarted","Data":"18323d1f8dc84cf9ae4ef9d616932003124eaa96c399b621c3a6705a60981090"}
Oct 30 20:58:41.726512 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:41.726013    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" event={"ID":"9703dc85-1cd0-44c8-881a-1a84c54961ad","Type":"ContainerStarted","Data":"181ded720d05ff23291ecfd4046a7092578e4b8f0b75b6ab26c923ecbfebca9f"}
Oct 30 20:58:41.750937 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:41.750888    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" podStartSLOduration=1.750873871 podStartE2EDuration="1.750873871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:41.749593953 +0000 UTC m=+1132.608330248" watchObservedRunningTime="2026-10-30 20:58:41.750873871 +0000 UTC m=+1132.609610163"
Oct 30 20:58:42.623040 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:42.623002    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:42.624502 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:42.624467    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Oct 30 20:58:42.624623 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:42.624520    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Oct 30 20:58:43.623580 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:43.623543    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Oct 30 20:58:43.624078 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:43.623608    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Oct 30 20:58:44.625046 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:44.623308    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Oct 30 20:58:44.625046 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:44.623383    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Oct 30 20:58:45.623732 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:45.623684    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Oct 30 20:58:45.623908 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:45.623784    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Oct 30 20:58:46.623133 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:46.623100    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Oct 30 20:58:46.623509 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:46.623155    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Oct 30 20:58:46.893460 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:58:46.893356    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:58:47.623576 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:47.623538    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Oct 30 20:58:47.623989 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:47.623632    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Oct 30 20:58:48.988699 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:48.988659    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:48.989276 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:48.989057    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:48.990520 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:48.990495    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 20:58:55.209008 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.208972    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"]
Oct 30 20:58:55.214894 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.214866    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.235467 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.230311    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"]
Oct 30 20:58:55.235467 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.230340    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-5a8f94-openshift-default-dockercfg-vl5jm\""
Oct 30 20:58:55.310360 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.310327    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.310546 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.310371    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.310546 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.310394    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/649feb12-6ac4-41a1-8632-e0faa768d083-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.310546 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.310483    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6brzn\" (UniqueName: \"kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-kube-api-access-6brzn\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.310546 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.310523    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.310766 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.310553    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.310766 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.310718    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.310870 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.310773    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.310870 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.310838    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/649feb12-6ac4-41a1-8632-e0faa768d083-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.412421 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.412386    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.412575 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.412429    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/649feb12-6ac4-41a1-8632-e0faa768d083-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.412575 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.412451    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6brzn\" (UniqueName: \"kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-kube-api-access-6brzn\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.412575 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.412471    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.412575 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.412502    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.412575 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.412557    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.412843 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.412595    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.412843 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.412633    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/649feb12-6ac4-41a1-8632-e0faa768d083-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.412843 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.412701    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.413001 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.412843    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.413001 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.412914    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.413001 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.412990    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.413144 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.413091    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.413478 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.413456    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/649feb12-6ac4-41a1-8632-e0faa768d083-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.414917 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.414889    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.415269 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.415246    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/649feb12-6ac4-41a1-8632-e0faa768d083-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.424197 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.424173    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6brzn\" (UniqueName: \"kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-kube-api-access-6brzn\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.424304 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.424285    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.543422 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.543347    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:55.827966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.827922    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"]
Oct 30 20:58:55.829856 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:58:55.829831    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649feb12_6ac4_41a1_8632_e0faa768d083.slice/crio-8b26323f4300c4be38fbd3f2e730e863dc7599f74eee9599a3fe0a154ccecda5 WatchSource:0}: Error finding container 8b26323f4300c4be38fbd3f2e730e863dc7599f74eee9599a3fe0a154ccecda5: Status 404 returned error can't find the container with id 8b26323f4300c4be38fbd3f2e730e863dc7599f74eee9599a3fe0a154ccecda5
Oct 30 20:58:55.832306 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.832276    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:58:55.832380 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.832339    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:58:55.832380 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.832367    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:58:55.872091 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:55.872063    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" event={"ID":"649feb12-6ac4-41a1-8632-e0faa768d083","Type":"ContainerStarted","Data":"8b26323f4300c4be38fbd3f2e730e863dc7599f74eee9599a3fe0a154ccecda5"}
Oct 30 20:58:56.878770 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:56.878731    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" event={"ID":"649feb12-6ac4-41a1-8632-e0faa768d083","Type":"ContainerStarted","Data":"dbbb47e1dd00e65154b5149257cfeb84099cfc81788b8f999cfeeb287e9516c8"}
Oct 30 20:58:56.906014 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:56.905963    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" podStartSLOduration=1.905949173 podStartE2EDuration="1.905949173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:56.902583774 +0000 UTC m=+1147.761320068" watchObservedRunningTime="2026-10-30 20:58:56.905949173 +0000 UTC m=+1147.764685465"
Oct 30 20:58:57.565045 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:57.563385    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:58:57.568419 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:57.568385    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Oct 30 20:58:57.568554 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:57.568460    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" podUID="649feb12-6ac4-41a1-8632-e0faa768d083" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Oct 30 20:58:58.562045 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:58.561140    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Oct 30 20:58:58.562045 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:58.561212    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" podUID="649feb12-6ac4-41a1-8632-e0faa768d083" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Oct 30 20:58:59.558462 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:59.558424    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Oct 30 20:58:59.558761 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:58:59.558727    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" podUID="649feb12-6ac4-41a1-8632-e0faa768d083" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Oct 30 20:59:00.567722 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:00.567675    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Oct 30 20:59:00.568321 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:00.567742    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" podUID="649feb12-6ac4-41a1-8632-e0faa768d083" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Oct 30 20:59:01.550049 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:01.548448    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Oct 30 20:59:01.550049 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:01.548510    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" podUID="649feb12-6ac4-41a1-8632-e0faa768d083" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Oct 30 20:59:03.425047 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:03.424386    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:59:03.429042 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:03.425654    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:59:03.439045 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:03.438541    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 20:59:10.883384 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:10.883350    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"]
Oct 30 20:59:10.887461 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:10.887435    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:10.906591 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:10.906560    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-c4b379-openshift-default-dockercfg-wchc9\""
Oct 30 20:59:10.926066 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:10.923851    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"]
Oct 30 20:59:11.061684 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.061634    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.061851 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.061741    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.061851 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.061769    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.061851 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.061843    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72gxg\" (UniqueName: \"kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-kube-api-access-72gxg\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.062035 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.061881    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.062089 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.062015    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.062146 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.062126    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.062201 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.062186    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c77a5d82-8c9e-4204-8c32-ef6585023df6-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.062238 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.062221    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.163333 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.163232    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.163333 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.163311    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.163577 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.163336    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.163577 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.163403    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72gxg\" (UniqueName: \"kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-kube-api-access-72gxg\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.163577 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.163435    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.163577 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.163464    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.163577 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.163494    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.163800 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.163632    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c77a5d82-8c9e-4204-8c32-ef6585023df6-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.163800 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.163702    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.163800 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.163721    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.163939 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.163853    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.164141 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.164119    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.164248 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.164178    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.164414 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.164396    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c77a5d82-8c9e-4204-8c32-ef6585023df6-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.165782 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.165762    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.166036 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.166003    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.175895 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.175863    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.176039 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.175935    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72gxg\" (UniqueName: \"kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-kube-api-access-72gxg\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.223089 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.223050    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:11.520053 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.519540    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"]
Oct 30 20:59:11.529591 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.527142    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:11.529591 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.527234    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:11.529591 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.527273    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:11.997616 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.997509    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" event={"ID":"c77a5d82-8c9e-4204-8c32-ef6585023df6","Type":"ContainerStarted","Data":"7c8a4e4284eb2b7eec021f31bcdf4f6c191c5d5a31878025ff55bb0852ddf818"}
Oct 30 20:59:11.998209 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:11.997665    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" event={"ID":"c77a5d82-8c9e-4204-8c32-ef6585023df6","Type":"ContainerStarted","Data":"040dacab8e940b4a92dd3cbccf2e6d2d1c5a2b22cd2256c063e673780f2261f3"}
Oct 30 20:59:12.036052 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:12.029620    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" podStartSLOduration=2.029598662 podStartE2EDuration="2.029598662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:12.025215203 +0000 UTC m=+1162.883951496" watchObservedRunningTime="2026-10-30 20:59:12.029598662 +0000 UTC m=+1162.888334956"
Oct 30 20:59:12.223873 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:12.223843    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:12.225142 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:12.225120    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 20:59:12.225206 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:12.225169    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 20:59:13.227182 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:13.227124    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 20:59:13.227686 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:13.227222    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 20:59:14.223767 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:14.223734    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 20:59:14.223934 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:14.223798    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 20:59:15.223784 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:15.223741    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 20:59:15.224228 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:15.223807    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 20:59:16.224002 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:16.223961    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 20:59:16.224429 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:16.224018    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 20:59:16.801459 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:59:16.801417    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:59:17.223510 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:17.223472    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 20:59:17.223668 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:17.223527    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 20:59:17.957909 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:17.957871    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"]
Oct 30 20:59:17.963015 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:17.962994    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:17.968247 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:17.968224    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:59:17.973075 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:17.968531    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 20:59:17.973075 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:17.970087    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"]
Oct 30 20:59:17.980544 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:17.979361    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-xks-ca\") pod \"maas-api-revoke-sub-293eed40-4mrpv\" (UID: \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:17.980744 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:17.980721    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-293eed40-4mrpv\" (UID: \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:17.980871 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:17.980856    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnjtq\" (UniqueName: \"kubernetes.io/projected/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-kube-api-access-jnjtq\") pod \"maas-api-revoke-sub-293eed40-4mrpv\" (UID: \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:18.081950 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:18.081918    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-xks-ca\") pod \"maas-api-revoke-sub-293eed40-4mrpv\" (UID: \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:18.082157 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:18.081966    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-293eed40-4mrpv\" (UID: \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:18.082157 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:18.081986    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnjtq\" (UniqueName: \"kubernetes.io/projected/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-kube-api-access-jnjtq\") pod \"maas-api-revoke-sub-293eed40-4mrpv\" (UID: \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:18.082850 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:18.082808    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-293eed40-4mrpv\" (UID: \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:18.084701 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:18.084670    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-xks-ca\") pod \"maas-api-revoke-sub-293eed40-4mrpv\" (UID: \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:18.094929 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:18.094904    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnjtq\" (UniqueName: \"kubernetes.io/projected/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-kube-api-access-jnjtq\") pod \"maas-api-revoke-sub-293eed40-4mrpv\" (UID: \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:18.267257 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:18.267139    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:18.267704 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:18.267672    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:18.269001 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:18.268981    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 20:59:18.287424 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:18.287400    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:18.579402 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:18.579339    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"]
Oct 30 20:59:18.583240 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:59:18.583214    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73bfa83c_ba27_4f6c_b3c8_ea3c010b2158.slice/crio-17007c6b9d61b23e3e8c056622ef4324f7f5134485eb636025dfbbb92bc588bd WatchSource:0}: Error finding container 17007c6b9d61b23e3e8c056622ef4324f7f5134485eb636025dfbbb92bc588bd: Status 404 returned error can't find the container with id 17007c6b9d61b23e3e8c056622ef4324f7f5134485eb636025dfbbb92bc588bd
Oct 30 20:59:18.585402 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:18.585385    6048 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:59:19.046934 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:19.046843    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv" event={"ID":"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158","Type":"ContainerStarted","Data":"17007c6b9d61b23e3e8c056622ef4324f7f5134485eb636025dfbbb92bc588bd"}
Oct 30 20:59:22.071799 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:22.071767    6048 generic.go:356] "Generic (PLEG): container finished" podID="73bfa83c-ba27-4f6c-b3c8-ea3c010b2158" containerID="34605b671f9147345dc2ca0caaa3af422adf5014c5d5568d252113c96f8701f7" exitCode=0
Oct 30 20:59:22.072165 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:22.071849    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv" event={"ID":"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158","Type":"ContainerDied","Data":"34605b671f9147345dc2ca0caaa3af422adf5014c5d5568d252113c96f8701f7"}
Oct 30 20:59:23.237133 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:23.237108    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:23.343216 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:23.343138    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-kube-api-access-jnjtq\" (UniqueName: \"kubernetes.io/projected/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-kube-api-access-jnjtq\") pod \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\" (UID: \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\") "
Oct 30 20:59:23.343355 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:23.343249    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-openshift-ca\") pod \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\" (UID: \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\") "
Oct 30 20:59:23.343355 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:23.343298    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-xks-ca\") pod \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\" (UID: \"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158\") "
Oct 30 20:59:23.343588 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:23.343559    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-openshift-ca" pod "73bfa83c-ba27-4f6c-b3c8-ea3c010b2158" (UID: "73bfa83c-ba27-4f6c-b3c8-ea3c010b2158"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:23.343864 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:23.343844    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:23.345918 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:23.345888    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-xks-ca" pod "73bfa83c-ba27-4f6c-b3c8-ea3c010b2158" (UID: "73bfa83c-ba27-4f6c-b3c8-ea3c010b2158"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:23.345918 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:23.345904    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-kube-api-access-jnjtq" pod "73bfa83c-ba27-4f6c-b3c8-ea3c010b2158" (UID: "73bfa83c-ba27-4f6c-b3c8-ea3c010b2158"). InnerVolumeSpecName "kube-api-access-jnjtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:23.445324 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:23.445293    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnjtq\" (UniqueName: \"kubernetes.io/projected/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-kube-api-access-jnjtq\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:23.445324 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:23.445321    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:24.084417 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:24.084385    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"
Oct 30 20:59:24.084417 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:24.084396    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv" event={"ID":"73bfa83c-ba27-4f6c-b3c8-ea3c010b2158","Type":"ContainerDied","Data":"17007c6b9d61b23e3e8c056622ef4324f7f5134485eb636025dfbbb92bc588bd"}
Oct 30 20:59:24.084674 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:24.084562    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17007c6b9d61b23e3e8c056622ef4324f7f5134485eb636025dfbbb92bc588bd"
Oct 30 20:59:32.506445 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.506337    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"]
Oct 30 20:59:32.507860 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.507828    6048 cpu_manager.go:414] "containerMap: removing container" podUID="73bfa83c-ba27-4f6c-b3c8-ea3c010b2158" containerName="revoke-keys"
Oct 30 20:59:32.508149 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.508130    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73bfa83c-ba27-4f6c-b3c8-ea3c010b2158" containerName="revoke-keys"
Oct 30 20:59:32.508452 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.508433    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="73bfa83c-ba27-4f6c-b3c8-ea3c010b2158" containerName="revoke-keys"
Oct 30 20:59:32.513703 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.513680    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:32.517936 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.517907    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"]
Oct 30 20:59:32.520193 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.520172    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 20:59:32.520193 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.520181    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:59:32.673722 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.673679    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2r9z\" (UniqueName: \"kubernetes.io/projected/3d8d77ef-6564-4089-9112-c53d155a3476-kube-api-access-m2r9z\") pod \"maas-api-revoke-sub-1322acf4-q2wq9\" (UID: \"3d8d77ef-6564-4089-9112-c53d155a3476\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:32.673887 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.673739    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1322acf4-q2wq9\" (UID: \"3d8d77ef-6564-4089-9112-c53d155a3476\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:32.673887 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.673822    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1322acf4-q2wq9\" (UID: \"3d8d77ef-6564-4089-9112-c53d155a3476\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:32.774903 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.774823    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2r9z\" (UniqueName: \"kubernetes.io/projected/3d8d77ef-6564-4089-9112-c53d155a3476-kube-api-access-m2r9z\") pod \"maas-api-revoke-sub-1322acf4-q2wq9\" (UID: \"3d8d77ef-6564-4089-9112-c53d155a3476\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:32.774903 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.774872    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1322acf4-q2wq9\" (UID: \"3d8d77ef-6564-4089-9112-c53d155a3476\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:32.775155 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.775131    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1322acf4-q2wq9\" (UID: \"3d8d77ef-6564-4089-9112-c53d155a3476\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:32.775735 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.775709    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1322acf4-q2wq9\" (UID: \"3d8d77ef-6564-4089-9112-c53d155a3476\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:32.777339 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.777314    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1322acf4-q2wq9\" (UID: \"3d8d77ef-6564-4089-9112-c53d155a3476\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:32.787437 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.787413    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2r9z\" (UniqueName: \"kubernetes.io/projected/3d8d77ef-6564-4089-9112-c53d155a3476-kube-api-access-m2r9z\") pod \"maas-api-revoke-sub-1322acf4-q2wq9\" (UID: \"3d8d77ef-6564-4089-9112-c53d155a3476\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:32.832256 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:32.832224    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:33.125824 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:33.125795    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"]
Oct 30 20:59:33.127456 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:59:33.127424    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8d77ef_6564_4089_9112_c53d155a3476.slice/crio-1a0ef15c207846f18561bed5d939c17180ea98debfd4f9171f3860acdef3ba9a WatchSource:0}: Error finding container 1a0ef15c207846f18561bed5d939c17180ea98debfd4f9171f3860acdef3ba9a: Status 404 returned error can't find the container with id 1a0ef15c207846f18561bed5d939c17180ea98debfd4f9171f3860acdef3ba9a
Oct 30 20:59:33.142095 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:33.142061    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9" event={"ID":"3d8d77ef-6564-4089-9112-c53d155a3476","Type":"ContainerStarted","Data":"1a0ef15c207846f18561bed5d939c17180ea98debfd4f9171f3860acdef3ba9a"}
Oct 30 20:59:33.941786 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:33.941751    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"]
Oct 30 20:59:33.945966 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:33.945942    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:33.955042 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:33.954863    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"]
Oct 30 20:59:34.091764 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.091737    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bc1326ae-b9fjd\" (UID: \"b728d161-5dc0-46f6-80a6-299e267d72ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:34.091899 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.091771    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phbh5\" (UniqueName: \"kubernetes.io/projected/b728d161-5dc0-46f6-80a6-299e267d72ec-kube-api-access-phbh5\") pod \"maas-api-revoke-sub-bc1326ae-b9fjd\" (UID: \"b728d161-5dc0-46f6-80a6-299e267d72ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:34.091899 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.091800    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bc1326ae-b9fjd\" (UID: \"b728d161-5dc0-46f6-80a6-299e267d72ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:34.149806 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.149777    6048 generic.go:356] "Generic (PLEG): container finished" podID="3d8d77ef-6564-4089-9112-c53d155a3476" containerID="c38ec13b3e5b1489ff30f5f5cd05e3be804481a6fa2be00d8c39979281873366" exitCode=0
Oct 30 20:59:34.149933 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.149873    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9" event={"ID":"3d8d77ef-6564-4089-9112-c53d155a3476","Type":"ContainerDied","Data":"c38ec13b3e5b1489ff30f5f5cd05e3be804481a6fa2be00d8c39979281873366"}
Oct 30 20:59:34.193156 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.193078    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bc1326ae-b9fjd\" (UID: \"b728d161-5dc0-46f6-80a6-299e267d72ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:34.193285 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.193258    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bc1326ae-b9fjd\" (UID: \"b728d161-5dc0-46f6-80a6-299e267d72ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:34.193285 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.193282    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phbh5\" (UniqueName: \"kubernetes.io/projected/b728d161-5dc0-46f6-80a6-299e267d72ec-kube-api-access-phbh5\") pod \"maas-api-revoke-sub-bc1326ae-b9fjd\" (UID: \"b728d161-5dc0-46f6-80a6-299e267d72ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:34.193970 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.193946    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bc1326ae-b9fjd\" (UID: \"b728d161-5dc0-46f6-80a6-299e267d72ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:34.195570 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.195551    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bc1326ae-b9fjd\" (UID: \"b728d161-5dc0-46f6-80a6-299e267d72ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:34.205779 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.205756    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phbh5\" (UniqueName: \"kubernetes.io/projected/b728d161-5dc0-46f6-80a6-299e267d72ec-kube-api-access-phbh5\") pod \"maas-api-revoke-sub-bc1326ae-b9fjd\" (UID: \"b728d161-5dc0-46f6-80a6-299e267d72ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:34.262997 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.262972    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:34.541590 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:34.541557    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"]
Oct 30 20:59:34.542970 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:59:34.542938    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb728d161_5dc0_46f6_80a6_299e267d72ec.slice/crio-6e06f3acf9955e5e3176492c96ab5c3a3543a8b13c6bdf0d0bb0495437858d5d WatchSource:0}: Error finding container 6e06f3acf9955e5e3176492c96ab5c3a3543a8b13c6bdf0d0bb0495437858d5d: Status 404 returned error can't find the container with id 6e06f3acf9955e5e3176492c96ab5c3a3543a8b13c6bdf0d0bb0495437858d5d
Oct 30 20:59:35.157839 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.157752    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd" event={"ID":"b728d161-5dc0-46f6-80a6-299e267d72ec","Type":"ContainerStarted","Data":"20fb2cd87d6bc4db1a9f19fe510d51a394bfff8cf77e72a9293c3d378e08aff9"}
Oct 30 20:59:35.157839 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.157810    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd" event={"ID":"b728d161-5dc0-46f6-80a6-299e267d72ec","Type":"ContainerStarted","Data":"6e06f3acf9955e5e3176492c96ab5c3a3543a8b13c6bdf0d0bb0495437858d5d"}
Oct 30 20:59:35.189329 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.189268    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd" podStartSLOduration=2.189252327 podStartE2EDuration="2.189252327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:35.176182955 +0000 UTC m=+1186.034919249" watchObservedRunningTime="2026-10-30 20:59:35.189252327 +0000 UTC m=+1186.047988620"
Oct 30 20:59:35.312590 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.312564    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:35.407794 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.407762    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-openshift-ca\") pod \"3d8d77ef-6564-4089-9112-c53d155a3476\" (UID: \"3d8d77ef-6564-4089-9112-c53d155a3476\") "
Oct 30 20:59:35.407987 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.407937    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-xks-ca\") pod \"3d8d77ef-6564-4089-9112-c53d155a3476\" (UID: \"3d8d77ef-6564-4089-9112-c53d155a3476\") "
Oct 30 20:59:35.407987 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.407969    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d8d77ef-6564-4089-9112-c53d155a3476-kube-api-access-m2r9z\" (UniqueName: \"kubernetes.io/projected/3d8d77ef-6564-4089-9112-c53d155a3476-kube-api-access-m2r9z\") pod \"3d8d77ef-6564-4089-9112-c53d155a3476\" (UID: \"3d8d77ef-6564-4089-9112-c53d155a3476\") "
Oct 30 20:59:35.408162 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.408138    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-openshift-ca" pod "3d8d77ef-6564-4089-9112-c53d155a3476" (UID: "3d8d77ef-6564-4089-9112-c53d155a3476"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:35.408487 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.408456    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:35.409977 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.409956    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-xks-ca" pod "3d8d77ef-6564-4089-9112-c53d155a3476" (UID: "3d8d77ef-6564-4089-9112-c53d155a3476"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:35.410087 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.409974    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d8d77ef-6564-4089-9112-c53d155a3476-kube-api-access-m2r9z" pod "3d8d77ef-6564-4089-9112-c53d155a3476" (UID: "3d8d77ef-6564-4089-9112-c53d155a3476"). InnerVolumeSpecName "kube-api-access-m2r9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:35.509612 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.509575    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3d8d77ef-6564-4089-9112-c53d155a3476-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:35.509612 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:35.509607    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2r9z\" (UniqueName: \"kubernetes.io/projected/3d8d77ef-6564-4089-9112-c53d155a3476-kube-api-access-m2r9z\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:36.165091 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:36.165049    6048 generic.go:356] "Generic (PLEG): container finished" podID="b728d161-5dc0-46f6-80a6-299e267d72ec" containerID="20fb2cd87d6bc4db1a9f19fe510d51a394bfff8cf77e72a9293c3d378e08aff9" exitCode=0
Oct 30 20:59:36.165513 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:36.165133    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd" event={"ID":"b728d161-5dc0-46f6-80a6-299e267d72ec","Type":"ContainerDied","Data":"20fb2cd87d6bc4db1a9f19fe510d51a394bfff8cf77e72a9293c3d378e08aff9"}
Oct 30 20:59:36.166543 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:36.166525    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"
Oct 30 20:59:36.166651 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:36.166567    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9" event={"ID":"3d8d77ef-6564-4089-9112-c53d155a3476","Type":"ContainerDied","Data":"1a0ef15c207846f18561bed5d939c17180ea98debfd4f9171f3860acdef3ba9a"}
Oct 30 20:59:36.166651 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:36.166613    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a0ef15c207846f18561bed5d939c17180ea98debfd4f9171f3860acdef3ba9a"
Oct 30 20:59:37.311406 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:37.311380    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:37.434373 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:37.434309    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-openshift-ca\") pod \"b728d161-5dc0-46f6-80a6-299e267d72ec\" (UID: \"b728d161-5dc0-46f6-80a6-299e267d72ec\") "
Oct 30 20:59:37.434512 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:37.434382    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-xks-ca\") pod \"b728d161-5dc0-46f6-80a6-299e267d72ec\" (UID: \"b728d161-5dc0-46f6-80a6-299e267d72ec\") "
Oct 30 20:59:37.434512 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:37.434491    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b728d161-5dc0-46f6-80a6-299e267d72ec-kube-api-access-phbh5\" (UniqueName: \"kubernetes.io/projected/b728d161-5dc0-46f6-80a6-299e267d72ec-kube-api-access-phbh5\") pod \"b728d161-5dc0-46f6-80a6-299e267d72ec\" (UID: \"b728d161-5dc0-46f6-80a6-299e267d72ec\") "
Oct 30 20:59:37.434743 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:37.434723    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-openshift-ca" pod "b728d161-5dc0-46f6-80a6-299e267d72ec" (UID: "b728d161-5dc0-46f6-80a6-299e267d72ec"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:37.435000 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:37.434980    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:37.436561 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:37.436535    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b728d161-5dc0-46f6-80a6-299e267d72ec-kube-api-access-phbh5" pod "b728d161-5dc0-46f6-80a6-299e267d72ec" (UID: "b728d161-5dc0-46f6-80a6-299e267d72ec"). InnerVolumeSpecName "kube-api-access-phbh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:37.436658 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:37.436562    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-xks-ca" pod "b728d161-5dc0-46f6-80a6-299e267d72ec" (UID: "b728d161-5dc0-46f6-80a6-299e267d72ec"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:37.536653 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:37.536618    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b728d161-5dc0-46f6-80a6-299e267d72ec-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:37.536653 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:37.536650    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phbh5\" (UniqueName: \"kubernetes.io/projected/b728d161-5dc0-46f6-80a6-299e267d72ec-kube-api-access-phbh5\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:38.178777 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:38.178737    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd" event={"ID":"b728d161-5dc0-46f6-80a6-299e267d72ec","Type":"ContainerDied","Data":"6e06f3acf9955e5e3176492c96ab5c3a3543a8b13c6bdf0d0bb0495437858d5d"}
Oct 30 20:59:38.178979 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:38.178809    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e06f3acf9955e5e3176492c96ab5c3a3543a8b13c6bdf0d0bb0495437858d5d"
Oct 30 20:59:38.178979 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:38.178747    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"
Oct 30 20:59:40.912879 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:40.912841    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"]
Oct 30 20:59:40.914678 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:40.914649    6048 cpu_manager.go:414] "containerMap: removing container" podUID="b728d161-5dc0-46f6-80a6-299e267d72ec" containerName="revoke-keys"
Oct 30 20:59:40.914831 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:40.914814    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b728d161-5dc0-46f6-80a6-299e267d72ec" containerName="revoke-keys"
Oct 30 20:59:40.914954 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:40.914942    6048 cpu_manager.go:414] "containerMap: removing container" podUID="3d8d77ef-6564-4089-9112-c53d155a3476" containerName="revoke-keys"
Oct 30 20:59:40.915045 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:40.915016    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d8d77ef-6564-4089-9112-c53d155a3476" containerName="revoke-keys"
Oct 30 20:59:40.915322 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:40.915303    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d8d77ef-6564-4089-9112-c53d155a3476" containerName="revoke-keys"
Oct 30 20:59:40.915449 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:40.915436    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="b728d161-5dc0-46f6-80a6-299e267d72ec" containerName="revoke-keys"
Oct 30 20:59:40.921899 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:40.921879    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:40.927725 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:40.927701    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"]
Oct 30 20:59:40.964940 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:40.964907    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-39fb96-openshift-default-dockercfg-t7kpm\""
Oct 30 20:59:41.006621 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.006596    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.006786 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.006629    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istiod-ca-cert\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.006786 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.006661    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-podinfo\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.006897 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.006852    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-token\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.006954 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.006937    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-certs\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.007006 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.006974    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dssw4\" (UniqueName: \"kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-kube-api-access-dssw4\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.007086 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.007074    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-envoy\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.007122 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.007102    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-data\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.007166 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.007130    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-credential-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.108383 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.108349    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.108523 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.108400    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istiod-ca-cert\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.108523 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.108448    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-podinfo\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.108523 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.108516    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-token\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.108642 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.108562    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-certs\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.108642 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.108601    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dssw4\" (UniqueName: \"kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-kube-api-access-dssw4\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.108747 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.108673    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-envoy\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.108747 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.108733    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-data\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.108851 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.108756    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.108851 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.108790    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-credential-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.108998 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.108977    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-certs\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.109274 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.109245    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-credential-socket\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.109274 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.109268    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istiod-ca-cert\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.109421 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.109322    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-data\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.110976 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.110947    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-envoy\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.111292 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.111270    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-podinfo\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.120611 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.120588    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-token\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.120689 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.120669    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dssw4\" (UniqueName: \"kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-kube-api-access-dssw4\") pod \"e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") " pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.235570 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.235482    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"]
Oct 30 20:59:41.240652 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.240627    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:41.240784 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.240767    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:41.245787 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.245284    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:59:41.245787 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.245482    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 20:59:41.248855 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.248832    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"]
Oct 30 20:59:41.310910 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.310875    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dde18254-jz4js\" (UID: \"14fa311e-623d-4d1f-bf25-afa22a9657be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:41.311073 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.310961    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dde18254-jz4js\" (UID: \"14fa311e-623d-4d1f-bf25-afa22a9657be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:41.311073 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.311014    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr94m\" (UniqueName: \"kubernetes.io/projected/14fa311e-623d-4d1f-bf25-afa22a9657be-kube-api-access-hr94m\") pod \"maas-api-revoke-sub-dde18254-jz4js\" (UID: \"14fa311e-623d-4d1f-bf25-afa22a9657be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:41.412570 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.412539    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dde18254-jz4js\" (UID: \"14fa311e-623d-4d1f-bf25-afa22a9657be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:41.412732 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.412602    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dde18254-jz4js\" (UID: \"14fa311e-623d-4d1f-bf25-afa22a9657be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:41.412732 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.412652    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr94m\" (UniqueName: \"kubernetes.io/projected/14fa311e-623d-4d1f-bf25-afa22a9657be-kube-api-access-hr94m\") pod \"maas-api-revoke-sub-dde18254-jz4js\" (UID: \"14fa311e-623d-4d1f-bf25-afa22a9657be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:41.413332 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.413305    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dde18254-jz4js\" (UID: \"14fa311e-623d-4d1f-bf25-afa22a9657be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:41.414998 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.414977    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dde18254-jz4js\" (UID: \"14fa311e-623d-4d1f-bf25-afa22a9657be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:41.425280 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.425257    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr94m\" (UniqueName: \"kubernetes.io/projected/14fa311e-623d-4d1f-bf25-afa22a9657be-kube-api-access-hr94m\") pod \"maas-api-revoke-sub-dde18254-jz4js\" (UID: \"14fa311e-623d-4d1f-bf25-afa22a9657be\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:41.534825 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.534798    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"]
Oct 30 20:59:41.537038 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:59:41.536998    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe9083c_53e0_4ad9_a4b4_a0ab01695b61.slice/crio-15031153f6d352317599e09f20823bd05971648509784d41ae274ccb9250691e WatchSource:0}: Error finding container 15031153f6d352317599e09f20823bd05971648509784d41ae274ccb9250691e: Status 404 returned error can't find the container with id 15031153f6d352317599e09f20823bd05971648509784d41ae274ccb9250691e
Oct 30 20:59:41.539413 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.539380    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:41.539486 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.539445    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:41.539486 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.539482    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 20:59:41.586535 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.586515    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:41.900685 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:41.900659    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"]
Oct 30 20:59:41.903127 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:59:41.903090    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fa311e_623d_4d1f_bf25_afa22a9657be.slice/crio-29c7a4fab7dcceb62d42a3b95fafc911c5d2913b5bdf058894258aaef72e6f94 WatchSource:0}: Error finding container 29c7a4fab7dcceb62d42a3b95fafc911c5d2913b5bdf058894258aaef72e6f94: Status 404 returned error can't find the container with id 29c7a4fab7dcceb62d42a3b95fafc911c5d2913b5bdf058894258aaef72e6f94
Oct 30 20:59:42.228873 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:42.228784    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" event={"ID":"abe9083c-53e0-4ad9-a4b4-a0ab01695b61","Type":"ContainerStarted","Data":"4e4a21d19eca6ac961dcd3ad879c3d90a3900975bba9c22a8b2ba08d42f075bd"}
Oct 30 20:59:42.228873 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:42.228839    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" event={"ID":"abe9083c-53e0-4ad9-a4b4-a0ab01695b61","Type":"ContainerStarted","Data":"15031153f6d352317599e09f20823bd05971648509784d41ae274ccb9250691e"}
Oct 30 20:59:42.230092 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:42.230071    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js" event={"ID":"14fa311e-623d-4d1f-bf25-afa22a9657be","Type":"ContainerStarted","Data":"29c7a4fab7dcceb62d42a3b95fafc911c5d2913b5bdf058894258aaef72e6f94"}
Oct 30 20:59:42.241767 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:42.241749    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:42.268105 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:42.266404    6048 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 20:59:42.268863 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:42.266485    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" podUID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 20:59:43.238685 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:43.238587    6048 generic.go:356] "Generic (PLEG): container finished" podID="14fa311e-623d-4d1f-bf25-afa22a9657be" containerID="e1a3a008c1ccfe46327cc6ed30643bed3665e65e4f2e53d78dfe0e1972692af1" exitCode=0
Oct 30 20:59:43.239135 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:43.238678    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js" event={"ID":"14fa311e-623d-4d1f-bf25-afa22a9657be","Type":"ContainerDied","Data":"e1a3a008c1ccfe46327cc6ed30643bed3665e65e4f2e53d78dfe0e1972692af1"}
Oct 30 20:59:43.241585 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:43.241560    6048 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 20:59:43.241637 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:43.241611    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" podUID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 20:59:43.286675 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:43.286581    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" podStartSLOduration=3.286561905 podStartE2EDuration="3.286561905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:42.269529972 +0000 UTC m=+1193.128266265" watchObservedRunningTime="2026-10-30 20:59:43.286561905 +0000 UTC m=+1194.145298200"
Oct 30 20:59:44.245767 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:44.245728    6048 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 20:59:44.246364 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:44.246331    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" podUID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 20:59:44.738923 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:44.738900    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:44.810864 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:44.810828    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14fa311e-623d-4d1f-bf25-afa22a9657be-kube-api-access-hr94m\" (UniqueName: \"kubernetes.io/projected/14fa311e-623d-4d1f-bf25-afa22a9657be-kube-api-access-hr94m\") pod \"14fa311e-623d-4d1f-bf25-afa22a9657be\" (UID: \"14fa311e-623d-4d1f-bf25-afa22a9657be\") "
Oct 30 20:59:44.811057 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:44.810952    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-openshift-ca\") pod \"14fa311e-623d-4d1f-bf25-afa22a9657be\" (UID: \"14fa311e-623d-4d1f-bf25-afa22a9657be\") "
Oct 30 20:59:44.811395 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:44.811366    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-openshift-ca" pod "14fa311e-623d-4d1f-bf25-afa22a9657be" (UID: "14fa311e-623d-4d1f-bf25-afa22a9657be"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:44.811759 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:44.811739    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-xks-ca\") pod \"14fa311e-623d-4d1f-bf25-afa22a9657be\" (UID: \"14fa311e-623d-4d1f-bf25-afa22a9657be\") "
Oct 30 20:59:44.812731 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:44.812706    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:44.813674 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:44.813648    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fa311e-623d-4d1f-bf25-afa22a9657be-kube-api-access-hr94m" pod "14fa311e-623d-4d1f-bf25-afa22a9657be" (UID: "14fa311e-623d-4d1f-bf25-afa22a9657be"). InnerVolumeSpecName "kube-api-access-hr94m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:44.816223 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:44.816201    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-xks-ca" pod "14fa311e-623d-4d1f-bf25-afa22a9657be" (UID: "14fa311e-623d-4d1f-bf25-afa22a9657be"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:44.914014 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:44.913980    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/14fa311e-623d-4d1f-bf25-afa22a9657be-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:44.914014 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:44.914011    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr94m\" (UniqueName: \"kubernetes.io/projected/14fa311e-623d-4d1f-bf25-afa22a9657be-kube-api-access-hr94m\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:45.242109 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:45.241989    6048 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 20:59:45.242109 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:45.242080    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" podUID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 20:59:45.303582 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:45.303550    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"
Oct 30 20:59:45.303980 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:45.303572    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js" event={"ID":"14fa311e-623d-4d1f-bf25-afa22a9657be","Type":"ContainerDied","Data":"29c7a4fab7dcceb62d42a3b95fafc911c5d2913b5bdf058894258aaef72e6f94"}
Oct 30 20:59:45.303980 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:45.303623    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29c7a4fab7dcceb62d42a3b95fafc911c5d2913b5bdf058894258aaef72e6f94"
Oct 30 20:59:46.241436 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.241398    6048 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 20:59:46.241627 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.241461    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" podUID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 20:59:46.725113 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.725080    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"]
Oct 30 20:59:46.725674 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.725660    6048 cpu_manager.go:414] "containerMap: removing container" podUID="14fa311e-623d-4d1f-bf25-afa22a9657be" containerName="revoke-keys"
Oct 30 20:59:46.725712 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.725674    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14fa311e-623d-4d1f-bf25-afa22a9657be" containerName="revoke-keys"
Oct 30 20:59:46.725784 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.725774    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="14fa311e-623d-4d1f-bf25-afa22a9657be" containerName="revoke-keys"
Oct 30 20:59:46.729651 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.729632    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:46.733413 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.733386    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f9ba84f8-bnnmq\" (UID: \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:46.733661 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.733642    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6wb4\" (UniqueName: \"kubernetes.io/projected/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-kube-api-access-b6wb4\") pod \"maas-api-revoke-sub-f9ba84f8-bnnmq\" (UID: \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:46.733703 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.733683    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f9ba84f8-bnnmq\" (UID: \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:46.738085 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.737763    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"]
Oct 30 20:59:46.738232 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.738203    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 20:59:46.738326 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.738263    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:59:46.803858 ip-10-0-131-162 kubenswrapper[6048]: E1030 20:59:46.803824    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 20:59:46.834851 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.834645    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f9ba84f8-bnnmq\" (UID: \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:46.834851 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.834792    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6wb4\" (UniqueName: \"kubernetes.io/projected/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-kube-api-access-b6wb4\") pod \"maas-api-revoke-sub-f9ba84f8-bnnmq\" (UID: \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:46.834851 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.834815    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f9ba84f8-bnnmq\" (UID: \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:46.835474 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.835445    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f9ba84f8-bnnmq\" (UID: \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:46.837248 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.837225    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f9ba84f8-bnnmq\" (UID: \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:46.870431 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:46.870360    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6wb4\" (UniqueName: \"kubernetes.io/projected/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-kube-api-access-b6wb4\") pod \"maas-api-revoke-sub-f9ba84f8-bnnmq\" (UID: \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:47.074648 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.074595    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:47.241404 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.241358    6048 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 30 20:59:47.241595 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.241438    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" podUID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 30 20:59:47.376316 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.376280    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"]
Oct 30 20:59:47.378571 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:59:47.378542    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7b5bff_913d_4ae9_a9da_6e84dfe9c8e8.slice/crio-394b7d70df57d22e5b18ffbba850785b988f837fb8cd57faeb07ca8956cb1711 WatchSource:0}: Error finding container 394b7d70df57d22e5b18ffbba850785b988f837fb8cd57faeb07ca8956cb1711: Status 404 returned error can't find the container with id 394b7d70df57d22e5b18ffbba850785b988f837fb8cd57faeb07ca8956cb1711
Oct 30 20:59:47.419770 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.419745    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"]
Oct 30 20:59:47.424822 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.424802    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:47.433000 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.432975    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"]
Oct 30 20:59:47.441738 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.441707    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2a96bb3b-w5xb5\" (UID: \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:47.441899 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.441878    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm8r8\" (UniqueName: \"kubernetes.io/projected/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-kube-api-access-hm8r8\") pod \"maas-api-revoke-sub-2a96bb3b-w5xb5\" (UID: \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:47.441967 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.441930    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2a96bb3b-w5xb5\" (UID: \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:47.548047 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.547916    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm8r8\" (UniqueName: \"kubernetes.io/projected/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-kube-api-access-hm8r8\") pod \"maas-api-revoke-sub-2a96bb3b-w5xb5\" (UID: \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:47.548047 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.548009    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2a96bb3b-w5xb5\" (UID: \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:47.548300 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.548129    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2a96bb3b-w5xb5\" (UID: \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:47.560062 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.559003    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2a96bb3b-w5xb5\" (UID: \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:47.563290 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.563254    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2a96bb3b-w5xb5\" (UID: \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:47.574057 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.573144    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm8r8\" (UniqueName: \"kubernetes.io/projected/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-kube-api-access-hm8r8\") pod \"maas-api-revoke-sub-2a96bb3b-w5xb5\" (UID: \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:47.741104 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:47.741063    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:48.020589 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:48.020560    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"]
Oct 30 20:59:48.023038 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:59:48.022997    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3aecaa_bdc2_486d_9095_dd8d7ac8c531.slice/crio-50099c1be4d2f2e77a3008ab5da0aef9ff5c0091bd49de011d9f02b86b23ca7f WatchSource:0}: Error finding container 50099c1be4d2f2e77a3008ab5da0aef9ff5c0091bd49de011d9f02b86b23ca7f: Status 404 returned error can't find the container with id 50099c1be4d2f2e77a3008ab5da0aef9ff5c0091bd49de011d9f02b86b23ca7f
Oct 30 20:59:48.331665 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:48.331620    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq" event={"ID":"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8","Type":"ContainerStarted","Data":"715fca57c25d474b37b3e8961dc5b2b06e40f6530a00eeed561c5fc7af58e02b"}
Oct 30 20:59:48.331886 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:48.331695    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq" event={"ID":"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8","Type":"ContainerStarted","Data":"394b7d70df57d22e5b18ffbba850785b988f837fb8cd57faeb07ca8956cb1711"}
Oct 30 20:59:48.333160 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:48.333129    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5" event={"ID":"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531","Type":"ContainerStarted","Data":"50099c1be4d2f2e77a3008ab5da0aef9ff5c0091bd49de011d9f02b86b23ca7f"}
Oct 30 20:59:48.349839 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:48.349702    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq" podStartSLOduration=2.349683074 podStartE2EDuration="2.349683074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:48.349365113 +0000 UTC m=+1199.208101405" watchObservedRunningTime="2026-10-30 20:59:48.349683074 +0000 UTC m=+1199.208419372"
Oct 30 20:59:48.372485 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:48.372291    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:48.373243 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:48.373218    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:48.374940 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:48.374903    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 20:59:49.340893 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:49.340858    6048 generic.go:356] "Generic (PLEG): container finished" podID="ec3aecaa-bdc2-486d-9095-dd8d7ac8c531" containerID="7c2e8737ab8d641f3b185d86328f8e5ef3e0f614b94631e3beb07535ac693279" exitCode=0
Oct 30 20:59:49.341346 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:49.340941    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5" event={"ID":"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531","Type":"ContainerDied","Data":"7c2e8737ab8d641f3b185d86328f8e5ef3e0f614b94631e3beb07535ac693279"}
Oct 30 20:59:49.342548 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:49.342522    6048 generic.go:356] "Generic (PLEG): container finished" podID="cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8" containerID="715fca57c25d474b37b3e8961dc5b2b06e40f6530a00eeed561c5fc7af58e02b" exitCode=0
Oct 30 20:59:49.342667 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:49.342583    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq" event={"ID":"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8","Type":"ContainerDied","Data":"715fca57c25d474b37b3e8961dc5b2b06e40f6530a00eeed561c5fc7af58e02b"}
Oct 30 20:59:50.516292 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.516261    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:50.552372 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.552344    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:50.597066 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.593437    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-kube-api-access-hm8r8\" (UniqueName: \"kubernetes.io/projected/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-kube-api-access-hm8r8\") pod \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\" (UID: \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\") "
Oct 30 20:59:50.597066 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.593489    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-xks-ca\") pod \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\" (UID: \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\") "
Oct 30 20:59:50.597066 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.593553    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-openshift-ca\") pod \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\" (UID: \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\") "
Oct 30 20:59:50.597066 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.593655    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-openshift-ca\") pod \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\" (UID: \"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531\") "
Oct 30 20:59:50.597066 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.593707    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-xks-ca\") pod \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\" (UID: \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\") "
Oct 30 20:59:50.597066 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.593757    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-kube-api-access-b6wb4\" (UniqueName: \"kubernetes.io/projected/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-kube-api-access-b6wb4\") pod \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\" (UID: \"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8\") "
Oct 30 20:59:50.597066 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.595949    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-openshift-ca" pod "cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8" (UID: "cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:50.597066 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.596117    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-openshift-ca" pod "ec3aecaa-bdc2-486d-9095-dd8d7ac8c531" (UID: "ec3aecaa-bdc2-486d-9095-dd8d7ac8c531"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:50.597651 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.597628    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-xks-ca" pod "cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8" (UID: "cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:50.597848 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.597823    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-xks-ca" pod "ec3aecaa-bdc2-486d-9095-dd8d7ac8c531" (UID: "ec3aecaa-bdc2-486d-9095-dd8d7ac8c531"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:50.598278 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.598250    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-kube-api-access-hm8r8" pod "ec3aecaa-bdc2-486d-9095-dd8d7ac8c531" (UID: "ec3aecaa-bdc2-486d-9095-dd8d7ac8c531"). InnerVolumeSpecName "kube-api-access-hm8r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:50.598363 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.598285    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-kube-api-access-b6wb4" pod "cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8" (UID: "cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8"). InnerVolumeSpecName "kube-api-access-b6wb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:50.695784 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.695744    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6wb4\" (UniqueName: \"kubernetes.io/projected/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-kube-api-access-b6wb4\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:50.695784 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.695777    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm8r8\" (UniqueName: \"kubernetes.io/projected/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-kube-api-access-hm8r8\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:50.695784 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.695788    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:50.696056 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.695797    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:50.696056 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.695806    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:50.696056 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:50.695816    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 20:59:51.364051 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:51.363457    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"
Oct 30 20:59:51.364051 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:51.363548    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq" event={"ID":"cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8","Type":"ContainerDied","Data":"394b7d70df57d22e5b18ffbba850785b988f837fb8cd57faeb07ca8956cb1711"}
Oct 30 20:59:51.364319 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:51.364124    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="394b7d70df57d22e5b18ffbba850785b988f837fb8cd57faeb07ca8956cb1711"
Oct 30 20:59:51.367052 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:51.365658    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5" event={"ID":"ec3aecaa-bdc2-486d-9095-dd8d7ac8c531","Type":"ContainerDied","Data":"50099c1be4d2f2e77a3008ab5da0aef9ff5c0091bd49de011d9f02b86b23ca7f"}
Oct 30 20:59:51.367052 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:51.365704    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50099c1be4d2f2e77a3008ab5da0aef9ff5c0091bd49de011d9f02b86b23ca7f"
Oct 30 20:59:51.367052 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:51.365768    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"
Oct 30 20:59:58.872186 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:58.872146    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"]
Oct 30 20:59:58.872809 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:58.872793    6048 cpu_manager.go:414] "containerMap: removing container" podUID="ec3aecaa-bdc2-486d-9095-dd8d7ac8c531" containerName="revoke-keys"
Oct 30 20:59:58.872856 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:58.872810    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ec3aecaa-bdc2-486d-9095-dd8d7ac8c531" containerName="revoke-keys"
Oct 30 20:59:58.872856 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:58.872832    6048 cpu_manager.go:414] "containerMap: removing container" podUID="cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8" containerName="revoke-keys"
Oct 30 20:59:58.872856 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:58.872838    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8" containerName="revoke-keys"
Oct 30 20:59:58.872948 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:58.872920    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8" containerName="revoke-keys"
Oct 30 20:59:58.872948 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:58.872929    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="ec3aecaa-bdc2-486d-9095-dd8d7ac8c531" containerName="revoke-keys"
Oct 30 20:59:58.880265 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:58.880245    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 20:59:58.884573 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:58.884544    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 20:59:58.884573 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:58.884545    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 20:59:58.887870 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:58.887844    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"]
Oct 30 20:59:59.073402 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:59.073368    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p885m\" (UniqueName: \"kubernetes.io/projected/00cad676-35e3-454e-aa9e-7d238294557c-kube-api-access-p885m\") pod \"maas-api-revoke-sub-6a4698fe-4zrjs\" (UID: \"00cad676-35e3-454e-aa9e-7d238294557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 20:59:59.073582 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:59.073443    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6a4698fe-4zrjs\" (UID: \"00cad676-35e3-454e-aa9e-7d238294557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 20:59:59.073582 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:59.073548    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6a4698fe-4zrjs\" (UID: \"00cad676-35e3-454e-aa9e-7d238294557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 20:59:59.174396 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:59.174302    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p885m\" (UniqueName: \"kubernetes.io/projected/00cad676-35e3-454e-aa9e-7d238294557c-kube-api-access-p885m\") pod \"maas-api-revoke-sub-6a4698fe-4zrjs\" (UID: \"00cad676-35e3-454e-aa9e-7d238294557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 20:59:59.174396 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:59.174381    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6a4698fe-4zrjs\" (UID: \"00cad676-35e3-454e-aa9e-7d238294557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 20:59:59.174622 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:59.174430    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6a4698fe-4zrjs\" (UID: \"00cad676-35e3-454e-aa9e-7d238294557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 20:59:59.175136 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:59.175116    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6a4698fe-4zrjs\" (UID: \"00cad676-35e3-454e-aa9e-7d238294557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 20:59:59.176660 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:59.176638    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6a4698fe-4zrjs\" (UID: \"00cad676-35e3-454e-aa9e-7d238294557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 20:59:59.189903 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:59.189880    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p885m\" (UniqueName: \"kubernetes.io/projected/00cad676-35e3-454e-aa9e-7d238294557c-kube-api-access-p885m\") pod \"maas-api-revoke-sub-6a4698fe-4zrjs\" (UID: \"00cad676-35e3-454e-aa9e-7d238294557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 20:59:59.197696 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:59.197673    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 20:59:59.476968 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:59.476939    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"]
Oct 30 20:59:59.478500 ip-10-0-131-162 kubenswrapper[6048]: W1030 20:59:59.478472    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00cad676_35e3_454e_aa9e_7d238294557c.slice/crio-1f2c1a076116a2aad48ebe50cfd6aae749206bb934843e08196dcb740dd3846f WatchSource:0}: Error finding container 1f2c1a076116a2aad48ebe50cfd6aae749206bb934843e08196dcb740dd3846f: Status 404 returned error can't find the container with id 1f2c1a076116a2aad48ebe50cfd6aae749206bb934843e08196dcb740dd3846f
Oct 30 20:59:59.563544 ip-10-0-131-162 kubenswrapper[6048]: I1030 20:59:59.563511    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs" event={"ID":"00cad676-35e3-454e-aa9e-7d238294557c","Type":"ContainerStarted","Data":"1f2c1a076116a2aad48ebe50cfd6aae749206bb934843e08196dcb740dd3846f"}
Oct 30 21:00:00.142199 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.142161    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"]
Oct 30 21:00:00.146530 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.146505    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:00.159013 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.158986    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"]
Oct 30 21:00:00.174933 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.174892    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"]
Oct 30 21:00:00.186236 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.185425    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"]
Oct 30 21:00:00.186236 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.185848    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"
Oct 30 21:00:00.197542 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.196113    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"]
Oct 30 21:00:00.203283 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.203252    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"
Oct 30 21:00:00.220504 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.220476    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"]
Oct 30 21:00:00.220775 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.220754    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"
Oct 30 21:00:00.225277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.225249    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"]
Oct 30 21:00:00.230448 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.230426    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"]
Oct 30 21:00:00.286227 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.286198    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79c283d6-5hr2r\" (UID: \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:00.286362 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.286265    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjf2f\" (UniqueName: \"kubernetes.io/projected/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-kube-api-access-hjf2f\") pod \"maas-api-revoke-sub-79c283d6-5hr2r\" (UID: \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:00.286362 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.286355    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee9767f2-13a4-4175-bea8-72f1d239a2e2-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445\" (UID: \"ee9767f2-13a4-4175-bea8-72f1d239a2e2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"
Oct 30 21:00:00.286459 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.286380    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79c283d6-5hr2r\" (UID: \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:00.286459 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.286418    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8vbh\" (UniqueName: \"kubernetes.io/projected/ee9767f2-13a4-4175-bea8-72f1d239a2e2-kube-api-access-h8vbh\") pod \"maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445\" (UID: \"ee9767f2-13a4-4175-bea8-72f1d239a2e2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"
Oct 30 21:00:00.387503 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.387470    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02f60cab-56f8-4e8a-ad41-f3d21c65072f-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889900-n62gg\" (UID: \"02f60cab-56f8-4e8a-ad41-f3d21c65072f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"
Oct 30 21:00:00.387641 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.387532    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pshfp\" (UniqueName: \"kubernetes.io/projected/02f60cab-56f8-4e8a-ad41-f3d21c65072f-kube-api-access-pshfp\") pod \"maas-api-key-cleanup-29889900-n62gg\" (UID: \"02f60cab-56f8-4e8a-ad41-f3d21c65072f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"
Oct 30 21:00:00.387706 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.387643    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79c283d6-5hr2r\" (UID: \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:00.387904 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.387867    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v\" (UID: \"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"
Oct 30 21:00:00.388066 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.387924    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjf2f\" (UniqueName: \"kubernetes.io/projected/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-kube-api-access-hjf2f\") pod \"maas-api-revoke-sub-79c283d6-5hr2r\" (UID: \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:00.388149 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.388080    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee9767f2-13a4-4175-bea8-72f1d239a2e2-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445\" (UID: \"ee9767f2-13a4-4175-bea8-72f1d239a2e2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"
Oct 30 21:00:00.388149 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.388121    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w727n\" (UniqueName: \"kubernetes.io/projected/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-kube-api-access-w727n\") pod \"maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v\" (UID: \"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"
Oct 30 21:00:00.388274 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.388157    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79c283d6-5hr2r\" (UID: \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:00.388389 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.388353    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8vbh\" (UniqueName: \"kubernetes.io/projected/ee9767f2-13a4-4175-bea8-72f1d239a2e2-kube-api-access-h8vbh\") pod \"maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445\" (UID: \"ee9767f2-13a4-4175-bea8-72f1d239a2e2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"
Oct 30 21:00:00.388501 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.388454    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79c283d6-5hr2r\" (UID: \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:00.388762 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.388741    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee9767f2-13a4-4175-bea8-72f1d239a2e2-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445\" (UID: \"ee9767f2-13a4-4175-bea8-72f1d239a2e2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"
Oct 30 21:00:00.390427 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.390407    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79c283d6-5hr2r\" (UID: \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:00.400240 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.400191    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8vbh\" (UniqueName: \"kubernetes.io/projected/ee9767f2-13a4-4175-bea8-72f1d239a2e2-kube-api-access-h8vbh\") pod \"maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445\" (UID: \"ee9767f2-13a4-4175-bea8-72f1d239a2e2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"
Oct 30 21:00:00.400240 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.400208    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjf2f\" (UniqueName: \"kubernetes.io/projected/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-kube-api-access-hjf2f\") pod \"maas-api-revoke-sub-79c283d6-5hr2r\" (UID: \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:00.460922 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.460882    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:00.489178 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.489150    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v\" (UID: \"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"
Oct 30 21:00:00.489319 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.489239    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w727n\" (UniqueName: \"kubernetes.io/projected/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-kube-api-access-w727n\") pod \"maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v\" (UID: \"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"
Oct 30 21:00:00.489319 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.489305    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02f60cab-56f8-4e8a-ad41-f3d21c65072f-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889900-n62gg\" (UID: \"02f60cab-56f8-4e8a-ad41-f3d21c65072f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"
Oct 30 21:00:00.489423 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.489356    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pshfp\" (UniqueName: \"kubernetes.io/projected/02f60cab-56f8-4e8a-ad41-f3d21c65072f-kube-api-access-pshfp\") pod \"maas-api-key-cleanup-29889900-n62gg\" (UID: \"02f60cab-56f8-4e8a-ad41-f3d21c65072f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"
Oct 30 21:00:00.489890 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.489830    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v\" (UID: \"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"
Oct 30 21:00:00.490120 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.490087    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02f60cab-56f8-4e8a-ad41-f3d21c65072f-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889900-n62gg\" (UID: \"02f60cab-56f8-4e8a-ad41-f3d21c65072f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"
Oct 30 21:00:00.501803 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.501774    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w727n\" (UniqueName: \"kubernetes.io/projected/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-kube-api-access-w727n\") pod \"maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v\" (UID: \"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"
Oct 30 21:00:00.501926 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.501804    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pshfp\" (UniqueName: \"kubernetes.io/projected/02f60cab-56f8-4e8a-ad41-f3d21c65072f-kube-api-access-pshfp\") pod \"maas-api-key-cleanup-29889900-n62gg\" (UID: \"02f60cab-56f8-4e8a-ad41-f3d21c65072f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"
Oct 30 21:00:00.531440 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.531408    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"
Oct 30 21:00:00.547447 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.547412    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"
Oct 30 21:00:00.553713 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.553684    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"
Oct 30 21:00:00.585297 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.585265    6048 generic.go:356] "Generic (PLEG): container finished" podID="00cad676-35e3-454e-aa9e-7d238294557c" containerID="82b769221542a761616c31b2ae0cc4136c856306ed4145bfc419a45992da6ce5" exitCode=0
Oct 30 21:00:00.585435 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.585331    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs" event={"ID":"00cad676-35e3-454e-aa9e-7d238294557c","Type":"ContainerDied","Data":"82b769221542a761616c31b2ae0cc4136c856306ed4145bfc419a45992da6ce5"}
Oct 30 21:00:00.749092 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.749060    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"]
Oct 30 21:00:00.749332 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:00.749303    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa1d5f8_757a_451f_bf2f_ca7af796ef5c.slice/crio-a0da097c8607e34445c6d7f1284ed8122ecd6b642d611011c108999bc4ba9155 WatchSource:0}: Error finding container a0da097c8607e34445c6d7f1284ed8122ecd6b642d611011c108999bc4ba9155: Status 404 returned error can't find the container with id a0da097c8607e34445c6d7f1284ed8122ecd6b642d611011c108999bc4ba9155
Oct 30 21:00:00.838078 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.838044    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"]
Oct 30 21:00:00.839466 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:00.839444    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9767f2_13a4_4175_bea8_72f1d239a2e2.slice/crio-e7a5b53d191894486fa9cdd31527b656161cf85e30d79932a80771337e109985 WatchSource:0}: Error finding container e7a5b53d191894486fa9cdd31527b656161cf85e30d79932a80771337e109985: Status 404 returned error can't find the container with id e7a5b53d191894486fa9cdd31527b656161cf85e30d79932a80771337e109985
Oct 30 21:00:00.880647 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.880620    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"]
Oct 30 21:00:00.893996 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:00.893966    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"]
Oct 30 21:00:00.945168 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:00.945083    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e411e3_ee77_4c3c_9d7f_7cdc75ab49eb.slice/crio-5c233fed264be24896bbf5f1500ba68402f7f7c9d93f1ade2e71bbe5592ac3f9 WatchSource:0}: Error finding container 5c233fed264be24896bbf5f1500ba68402f7f7c9d93f1ade2e71bbe5592ac3f9: Status 404 returned error can't find the container with id 5c233fed264be24896bbf5f1500ba68402f7f7c9d93f1ade2e71bbe5592ac3f9
Oct 30 21:00:00.946424 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:00.946396    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f60cab_56f8_4e8a_ad41_f3d21c65072f.slice/crio-da8f5cac9baf61bb6095fcbcec07c2e85831bceba1ec63b8af0ae7131a604f8d WatchSource:0}: Error finding container da8f5cac9baf61bb6095fcbcec07c2e85831bceba1ec63b8af0ae7131a604f8d: Status 404 returned error can't find the container with id da8f5cac9baf61bb6095fcbcec07c2e85831bceba1ec63b8af0ae7131a604f8d
Oct 30 21:00:01.593324 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.593283    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445" event={"ID":"ee9767f2-13a4-4175-bea8-72f1d239a2e2","Type":"ContainerStarted","Data":"8fd9e86f462a3d112110fb795f22e136b0130c4eb611c8e8b63f3c84b05df6a8"}
Oct 30 21:00:01.593785 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.593349    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445" event={"ID":"ee9767f2-13a4-4175-bea8-72f1d239a2e2","Type":"ContainerStarted","Data":"e7a5b53d191894486fa9cdd31527b656161cf85e30d79932a80771337e109985"}
Oct 30 21:00:01.594882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.594857    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r" event={"ID":"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c","Type":"ContainerStarted","Data":"434383dfb871b54ebfbee0ad4993468b343e56d7b47e0bfc0818323f600a8252"}
Oct 30 21:00:01.594995 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.594900    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r" event={"ID":"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c","Type":"ContainerStarted","Data":"a0da097c8607e34445c6d7f1284ed8122ecd6b642d611011c108999bc4ba9155"}
Oct 30 21:00:01.596461 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.596429    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v" event={"ID":"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb","Type":"ContainerStarted","Data":"bb09118f95bf6b37afaf2d9014e159326008be2ff1aa571c240636aca6a32c2a"}
Oct 30 21:00:01.596573 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.596480    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v" event={"ID":"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb","Type":"ContainerStarted","Data":"5c233fed264be24896bbf5f1500ba68402f7f7c9d93f1ade2e71bbe5592ac3f9"}
Oct 30 21:00:01.598114 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.598081    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg" event={"ID":"02f60cab-56f8-4e8a-ad41-f3d21c65072f","Type":"ContainerStarted","Data":"e97a042bd3ea7a733b8ae733c5d27c5bbf6793db485ea1f098e8ce3e76bb2179"}
Oct 30 21:00:01.598213 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.598140    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg" event={"ID":"02f60cab-56f8-4e8a-ad41-f3d21c65072f","Type":"ContainerStarted","Data":"da8f5cac9baf61bb6095fcbcec07c2e85831bceba1ec63b8af0ae7131a604f8d"}
Oct 30 21:00:01.614616 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.614552    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445" podStartSLOduration=1.614538446 podStartE2EDuration="1.614538446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:01.611882666 +0000 UTC m=+1212.470618956" watchObservedRunningTime="2026-10-30 21:00:01.614538446 +0000 UTC m=+1212.473274739"
Oct 30 21:00:01.636784 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.636721    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r" podStartSLOduration=1.6367022150000001 podStartE2EDuration="1.636702215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:01.632937119 +0000 UTC m=+1212.491673414" watchObservedRunningTime="2026-10-30 21:00:01.636702215 +0000 UTC m=+1212.495438507"
Oct 30 21:00:01.652438 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.652374    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg" podStartSLOduration=1.652356117 podStartE2EDuration="1.652356117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:01.650235295 +0000 UTC m=+1212.508971587" watchObservedRunningTime="2026-10-30 21:00:01.652356117 +0000 UTC m=+1212.511092411"
Oct 30 21:00:01.676722 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.676667    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v" podStartSLOduration=1.676648436 podStartE2EDuration="1.676648436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:01.673560506 +0000 UTC m=+1212.532296799" watchObservedRunningTime="2026-10-30 21:00:01.676648436 +0000 UTC m=+1212.535384732"
Oct 30 21:00:01.753565 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.753536    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 21:00:01.806542 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.806511    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-openshift-ca\") pod \"00cad676-35e3-454e-aa9e-7d238294557c\" (UID: \"00cad676-35e3-454e-aa9e-7d238294557c\") "
Oct 30 21:00:01.806724 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.806566    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00cad676-35e3-454e-aa9e-7d238294557c-kube-api-access-p885m\" (UniqueName: \"kubernetes.io/projected/00cad676-35e3-454e-aa9e-7d238294557c-kube-api-access-p885m\") pod \"00cad676-35e3-454e-aa9e-7d238294557c\" (UID: \"00cad676-35e3-454e-aa9e-7d238294557c\") "
Oct 30 21:00:01.806806 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.806715    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-xks-ca\") pod \"00cad676-35e3-454e-aa9e-7d238294557c\" (UID: \"00cad676-35e3-454e-aa9e-7d238294557c\") "
Oct 30 21:00:01.806923 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.806898    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-openshift-ca" pod "00cad676-35e3-454e-aa9e-7d238294557c" (UID: "00cad676-35e3-454e-aa9e-7d238294557c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:01.807325 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.807301    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:01.808818 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.808789    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00cad676-35e3-454e-aa9e-7d238294557c-kube-api-access-p885m" pod "00cad676-35e3-454e-aa9e-7d238294557c" (UID: "00cad676-35e3-454e-aa9e-7d238294557c"). InnerVolumeSpecName "kube-api-access-p885m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:01.808912 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.808839    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-xks-ca" pod "00cad676-35e3-454e-aa9e-7d238294557c" (UID: "00cad676-35e3-454e-aa9e-7d238294557c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:01.908445 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.908410    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p885m\" (UniqueName: \"kubernetes.io/projected/00cad676-35e3-454e-aa9e-7d238294557c-kube-api-access-p885m\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:01.908445 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:01.908441    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/00cad676-35e3-454e-aa9e-7d238294557c-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:02.605941 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.605901    6048 generic.go:356] "Generic (PLEG): container finished" podID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" containerID="bb09118f95bf6b37afaf2d9014e159326008be2ff1aa571c240636aca6a32c2a" exitCode=60
Oct 30 21:00:02.606425 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.605939    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v" event={"ID":"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb","Type":"ContainerDied","Data":"bb09118f95bf6b37afaf2d9014e159326008be2ff1aa571c240636aca6a32c2a"}
Oct 30 21:00:02.606425 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.606312    6048 scope.go:122] "RemoveContainer" containerID="bb09118f95bf6b37afaf2d9014e159326008be2ff1aa571c240636aca6a32c2a"
Oct 30 21:00:02.607524 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.607506    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"
Oct 30 21:00:02.607626 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.607547    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs" event={"ID":"00cad676-35e3-454e-aa9e-7d238294557c","Type":"ContainerDied","Data":"1f2c1a076116a2aad48ebe50cfd6aae749206bb934843e08196dcb740dd3846f"}
Oct 30 21:00:02.607626 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.607593    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f2c1a076116a2aad48ebe50cfd6aae749206bb934843e08196dcb740dd3846f"
Oct 30 21:00:02.609259 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.609238    6048 generic.go:356] "Generic (PLEG): container finished" podID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" containerID="e97a042bd3ea7a733b8ae733c5d27c5bbf6793db485ea1f098e8ce3e76bb2179" exitCode=60
Oct 30 21:00:02.609432 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.609315    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg" event={"ID":"02f60cab-56f8-4e8a-ad41-f3d21c65072f","Type":"ContainerDied","Data":"e97a042bd3ea7a733b8ae733c5d27c5bbf6793db485ea1f098e8ce3e76bb2179"}
Oct 30 21:00:02.609606 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.609503    6048 scope.go:122] "RemoveContainer" containerID="e97a042bd3ea7a733b8ae733c5d27c5bbf6793db485ea1f098e8ce3e76bb2179"
Oct 30 21:00:02.613275 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.611541    6048 generic.go:356] "Generic (PLEG): container finished" podID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" containerID="8fd9e86f462a3d112110fb795f22e136b0130c4eb611c8e8b63f3c84b05df6a8" exitCode=60
Oct 30 21:00:02.613275 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.611604    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445" event={"ID":"ee9767f2-13a4-4175-bea8-72f1d239a2e2","Type":"ContainerDied","Data":"8fd9e86f462a3d112110fb795f22e136b0130c4eb611c8e8b63f3c84b05df6a8"}
Oct 30 21:00:02.613275 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.611815    6048 scope.go:122] "RemoveContainer" containerID="8fd9e86f462a3d112110fb795f22e136b0130c4eb611c8e8b63f3c84b05df6a8"
Oct 30 21:00:02.613385 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.613327    6048 generic.go:356] "Generic (PLEG): container finished" podID="8aa1d5f8-757a-451f-bf2f-ca7af796ef5c" containerID="434383dfb871b54ebfbee0ad4993468b343e56d7b47e0bfc0818323f600a8252" exitCode=0
Oct 30 21:00:02.613385 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:02.613358    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r" event={"ID":"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c","Type":"ContainerDied","Data":"434383dfb871b54ebfbee0ad4993468b343e56d7b47e0bfc0818323f600a8252"}
Oct 30 21:00:03.621363 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.621328    6048 generic.go:356] "Generic (PLEG): container finished" podID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" containerID="8e25818c72536cc9729d8cba408f0771ec4f72f64468e2b184df6cbc498a2bed" exitCode=60
Oct 30 21:00:03.621778 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.621407    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445" event={"ID":"ee9767f2-13a4-4175-bea8-72f1d239a2e2","Type":"ContainerDied","Data":"8e25818c72536cc9729d8cba408f0771ec4f72f64468e2b184df6cbc498a2bed"}
Oct 30 21:00:03.621778 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.621467    6048 scope.go:122] "RemoveContainer" containerID="8fd9e86f462a3d112110fb795f22e136b0130c4eb611c8e8b63f3c84b05df6a8"
Oct 30 21:00:03.621778 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.621739    6048 scope.go:122] "RemoveContainer" containerID="8e25818c72536cc9729d8cba408f0771ec4f72f64468e2b184df6cbc498a2bed"
Oct 30 21:00:03.622111 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:00:03.622077    6048 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445_odh-ai-gateway-infra(ee9767f2-13a4-4175-bea8-72f1d239a2e2)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2"
Oct 30 21:00:03.623742 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.623717    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v" event={"ID":"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb","Type":"ContainerStarted","Data":"60d8c22b09573ea45145f3ce9491b8ac3c98141da882738946b6f89712524d33"}
Oct 30 21:00:03.625701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.625680    6048 generic.go:356] "Generic (PLEG): container finished" podID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" containerID="eaedff4601c329f0b86f991fa577bc566e32baf8ead07e94d9e186d41cbd348d" exitCode=60
Oct 30 21:00:03.625802 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.625740    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg" event={"ID":"02f60cab-56f8-4e8a-ad41-f3d21c65072f","Type":"ContainerDied","Data":"eaedff4601c329f0b86f991fa577bc566e32baf8ead07e94d9e186d41cbd348d"}
Oct 30 21:00:03.625991 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.625971    6048 scope.go:122] "RemoveContainer" containerID="eaedff4601c329f0b86f991fa577bc566e32baf8ead07e94d9e186d41cbd348d"
Oct 30 21:00:03.626280 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:00:03.626259    6048 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889900-n62gg_odh-ai-gateway-infra(02f60cab-56f8-4e8a-ad41-f3d21c65072f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg" podUID="02f60cab-56f8-4e8a-ad41-f3d21c65072f"
Oct 30 21:00:03.726731 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.726704    6048 scope.go:122] "RemoveContainer" containerID="e97a042bd3ea7a733b8ae733c5d27c5bbf6793db485ea1f098e8ce3e76bb2179"
Oct 30 21:00:03.811201 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.811176    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:03.834403 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.834375    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-kube-api-access-hjf2f\" (UniqueName: \"kubernetes.io/projected/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-kube-api-access-hjf2f\") pod \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\" (UID: \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\") "
Oct 30 21:00:03.834535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.834425    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-openshift-ca\") pod \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\" (UID: \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\") "
Oct 30 21:00:03.834535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.834512    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-xks-ca\") pod \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\" (UID: \"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c\") "
Oct 30 21:00:03.834834 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.834790    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-openshift-ca" pod "8aa1d5f8-757a-451f-bf2f-ca7af796ef5c" (UID: "8aa1d5f8-757a-451f-bf2f-ca7af796ef5c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:03.834982 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.834959    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:03.836558 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.836531    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-kube-api-access-hjf2f" pod "8aa1d5f8-757a-451f-bf2f-ca7af796ef5c" (UID: "8aa1d5f8-757a-451f-bf2f-ca7af796ef5c"). InnerVolumeSpecName "kube-api-access-hjf2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:03.836880 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.836859    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-xks-ca" pod "8aa1d5f8-757a-451f-bf2f-ca7af796ef5c" (UID: "8aa1d5f8-757a-451f-bf2f-ca7af796ef5c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:03.936373 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.936307    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjf2f\" (UniqueName: \"kubernetes.io/projected/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-kube-api-access-hjf2f\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:03.936373 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:03.936374    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:04.633973 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:04.633936    6048 scope.go:122] "RemoveContainer" containerID="eaedff4601c329f0b86f991fa577bc566e32baf8ead07e94d9e186d41cbd348d"
Oct 30 21:00:04.634476 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:00:04.634279    6048 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889900-n62gg_odh-ai-gateway-infra(02f60cab-56f8-4e8a-ad41-f3d21c65072f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg" podUID="02f60cab-56f8-4e8a-ad41-f3d21c65072f"
Oct 30 21:00:04.635988 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:04.635938    6048 scope.go:122] "RemoveContainer" containerID="8e25818c72536cc9729d8cba408f0771ec4f72f64468e2b184df6cbc498a2bed"
Oct 30 21:00:04.636315 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:00:04.636290    6048 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445_odh-ai-gateway-infra(ee9767f2-13a4-4175-bea8-72f1d239a2e2)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2"
Oct 30 21:00:04.637117 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:04.637094    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"
Oct 30 21:00:04.637208 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:04.637122    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r" event={"ID":"8aa1d5f8-757a-451f-bf2f-ca7af796ef5c","Type":"ContainerDied","Data":"a0da097c8607e34445c6d7f1284ed8122ecd6b642d611011c108999bc4ba9155"}
Oct 30 21:00:04.637208 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:04.637171    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0da097c8607e34445c6d7f1284ed8122ecd6b642d611011c108999bc4ba9155"
Oct 30 21:00:04.640701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:04.640676    6048 generic.go:356] "Generic (PLEG): container finished" podID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" containerID="60d8c22b09573ea45145f3ce9491b8ac3c98141da882738946b6f89712524d33" exitCode=60
Oct 30 21:00:04.640814 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:04.640736    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v" event={"ID":"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb","Type":"ContainerDied","Data":"60d8c22b09573ea45145f3ce9491b8ac3c98141da882738946b6f89712524d33"}
Oct 30 21:00:04.640814 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:04.640784    6048 scope.go:122] "RemoveContainer" containerID="bb09118f95bf6b37afaf2d9014e159326008be2ff1aa571c240636aca6a32c2a"
Oct 30 21:00:04.641004 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:04.640989    6048 scope.go:122] "RemoveContainer" containerID="60d8c22b09573ea45145f3ce9491b8ac3c98141da882738946b6f89712524d33"
Oct 30 21:00:04.641240 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:00:04.641221    6048 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v_odh-ai-gateway-infra(72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb"
Oct 30 21:00:05.648904 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:05.648875    6048 scope.go:122] "RemoveContainer" containerID="60d8c22b09573ea45145f3ce9491b8ac3c98141da882738946b6f89712524d33"
Oct 30 21:00:05.649292 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:00:05.649215    6048 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v_odh-ai-gateway-infra(72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb"
Oct 30 21:00:09.690056 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.688087    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"]
Oct 30 21:00:09.737012 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.724315    6048 cpu_manager.go:414] "containerMap: removing container" podUID="8aa1d5f8-757a-451f-bf2f-ca7af796ef5c" containerName="revoke-keys"
Oct 30 21:00:09.737012 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.724348    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8aa1d5f8-757a-451f-bf2f-ca7af796ef5c" containerName="revoke-keys"
Oct 30 21:00:09.737012 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.724496    6048 cpu_manager.go:414] "containerMap: removing container" podUID="00cad676-35e3-454e-aa9e-7d238294557c" containerName="revoke-keys"
Oct 30 21:00:09.737012 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.724524    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="00cad676-35e3-454e-aa9e-7d238294557c" containerName="revoke-keys"
Oct 30 21:00:09.737012 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.725042    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="00cad676-35e3-454e-aa9e-7d238294557c" containerName="revoke-keys"
Oct 30 21:00:09.737012 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.725086    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="8aa1d5f8-757a-451f-bf2f-ca7af796ef5c" containerName="revoke-keys"
Oct 30 21:00:09.737012 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.736175    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"]
Oct 30 21:00:09.737012 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.736319    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.822828 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.822791    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.822992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.822917    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.822992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.822979    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.823170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.823155    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.823244 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.823226    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khzgj\" (UniqueName: \"kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-kube-api-access-khzgj\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.823317 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.823296    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.823371 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.823358    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.823410 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.823401    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.823447 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.823418    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.924417 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.924376    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.924609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.924450    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.924609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.924470    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.924609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.924521    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.924609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.924566    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.924609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.924593    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.924936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.924654    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.924936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.924717    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khzgj\" (UniqueName: \"kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-kube-api-access-khzgj\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.924936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.924744    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.924936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.924886    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.925084 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.924960    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.925149 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.925126    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.925306 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.925281    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.925423 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.925317    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.927178 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.927156    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.927327 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.927308    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.937978 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.937922    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:09.938115 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:09.938052    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khzgj\" (UniqueName: \"kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-kube-api-access-khzgj\") pod \"maas-default-gateway-openshift-default-58c6585447-q8xpm\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:10.083565 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.083525    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:10.401470 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.401344    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"]
Oct 30 21:00:10.408284 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.408241    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:10.408409 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.408332    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:10.408409 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.408380    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:10.761666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.761559    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" event={"ID":"a9fdb83e-0e08-4749-b33d-6cc1eb189791","Type":"ContainerStarted","Data":"ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df"}
Oct 30 21:00:10.761666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.761628    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" event={"ID":"a9fdb83e-0e08-4749-b33d-6cc1eb189791","Type":"ContainerStarted","Data":"1c4e6dd12aa22979e3c5c630749234d187dcebad037450e2eac43cebe31e4416"}
Oct 30 21:00:10.810315 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.810000    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podStartSLOduration=1.809985572 podStartE2EDuration="1.809985572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:10.808714262 +0000 UTC m=+1221.667450594" watchObservedRunningTime="2026-10-30 21:00:10.809985572 +0000 UTC m=+1221.668721863"
Oct 30 21:00:10.824103 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.824068    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"]
Oct 30 21:00:10.829386 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.829361    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:10.856885 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.856487    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"]
Oct 30 21:00:10.941058 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.940995    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:10.941220 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.941079    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:10.941220 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.941140    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:10.941295 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.941273    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:10.941342 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.941329    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bef2832-cf0e-4334-9d10-0d123781cdb4-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:10.941431 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.941410    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:10.941512 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.941496    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpvn6\" (UniqueName: \"kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-kube-api-access-qpvn6\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:10.941591 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.941578    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:10.941660 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.941641    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:10.966768 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.966730    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"]
Oct 30 21:00:10.971114 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.971092    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:10.982441 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.980361    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:00:10.984979 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:10.984949    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"]
Oct 30 21:00:11.016552 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.016465    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"]
Oct 30 21:00:11.022234 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.022205    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.040160 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.040046    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"]
Oct 30 21:00:11.043366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.043076    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtrpj\" (UniqueName: \"kubernetes.io/projected/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-kube-api-access-dtrpj\") pod \"maas-api-revoke-sub-6dbaa05f-w8w98\" (UID: \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:11.043366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.043132    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.043366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.043191    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.043366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.043222    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.043366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.043247    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6dbaa05f-w8w98\" (UID: \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:11.043366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.043274    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.043366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.043313    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.043830 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.043445    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.043830 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.043482    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6dbaa05f-w8w98\" (UID: \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:11.043830 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.043530    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bef2832-cf0e-4334-9d10-0d123781cdb4-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.043830 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.043568    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.043830 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.043657    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpvn6\" (UniqueName: \"kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-kube-api-access-qpvn6\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.044709 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.044682    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.046663 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.045781    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bef2832-cf0e-4334-9d10-0d123781cdb4-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.046663 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.046090    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.046663 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.046616    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.047216 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.047170    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.047923 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.047899    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.050276 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.050252    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.062553 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.062525    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpvn6\" (UniqueName: \"kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-kube-api-access-qpvn6\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.071747 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.071713    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.084518 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.084491    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:11.086099 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.086070    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q8xpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:00:11.086204 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.086126    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 21:00:11.144430 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.144394    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.144601 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.144445    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.144601 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.144564    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6dbaa05f-w8w98\" (UID: \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:11.144601 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.144595    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.144718 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.144645    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.144800 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.144781    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.144854 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.144835    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrpj\" (UniqueName: \"kubernetes.io/projected/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-kube-api-access-dtrpj\") pod \"maas-api-revoke-sub-6dbaa05f-w8w98\" (UID: \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:11.144938 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.144918    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.144979 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.144950    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.145050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.145010    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6dbaa05f-w8w98\" (UID: \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:11.145105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.145075    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.145235 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.145210    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4kg4\" (UniqueName: \"kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-kube-api-access-h4kg4\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.145619 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.145602    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6dbaa05f-w8w98\" (UID: \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:11.146893 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.146876    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6dbaa05f-w8w98\" (UID: \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:11.148926 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.148906    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:11.157201 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.157179    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtrpj\" (UniqueName: \"kubernetes.io/projected/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-kube-api-access-dtrpj\") pod \"maas-api-revoke-sub-6dbaa05f-w8w98\" (UID: \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.246803    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.247441    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.247572    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.247599    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.247644    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.247781    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4kg4\" (UniqueName: \"kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-kube-api-access-h4kg4\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.247827    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.248077    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.248761    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.247270    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.248943    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.249662    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.249737    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.250966 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.250510    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.252928 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.252545    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.255086 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.255058    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.263530 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.263497    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4kg4\" (UniqueName: \"kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-kube-api-access-h4kg4\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.267161 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.267059    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.288858 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.288560    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:11.348587 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.348298    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:11.475469 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.475416    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"]
Oct 30 21:00:11.479906 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:11.479851    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bef2832_cf0e_4334_9d10_0d123781cdb4.slice/crio-c657655d607d2e227a13496f3696d0dd1978c6b3709b8109f646a2d6a6f773a2 WatchSource:0}: Error finding container c657655d607d2e227a13496f3696d0dd1978c6b3709b8109f646a2d6a6f773a2: Status 404 returned error can't find the container with id c657655d607d2e227a13496f3696d0dd1978c6b3709b8109f646a2d6a6f773a2
Oct 30 21:00:11.483048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.482980    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:11.483723 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.483266    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:11.483723 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.483334    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:11.604411 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.604165    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"]
Oct 30 21:00:11.605917 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:11.605882    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476fc1eb_7bc7_4cde_9e2d_28e71cbb681c.slice/crio-5124d74b89545c63bb4c44ff8cfa10354a1df70e7f28ca92f0a9d8cae14f6b51 WatchSource:0}: Error finding container 5124d74b89545c63bb4c44ff8cfa10354a1df70e7f28ca92f0a9d8cae14f6b51: Status 404 returned error can't find the container with id 5124d74b89545c63bb4c44ff8cfa10354a1df70e7f28ca92f0a9d8cae14f6b51
Oct 30 21:00:11.711698 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.711670    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"]
Oct 30 21:00:11.799074 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.794487    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:11.799074 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.794588    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:11.799074 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.794665    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:11.802931 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.802857    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" event={"ID":"172e9bb0-da74-45a8-9bdf-b40f49a91b2b","Type":"ContainerStarted","Data":"c667dd1f6be29f56de8782707dc45fbcd89bec960732895f93c882cb20b656c2"}
Oct 30 21:00:11.804541 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.804487    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98" event={"ID":"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c","Type":"ContainerStarted","Data":"5124d74b89545c63bb4c44ff8cfa10354a1df70e7f28ca92f0a9d8cae14f6b51"}
Oct 30 21:00:11.806184 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.806160    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" event={"ID":"0bef2832-cf0e-4334-9d10-0d123781cdb4","Type":"ContainerStarted","Data":"0b85b680f5d324ed52b2e20a64ac02ca46f5daa9f5b8fc9cd93bab2a5a771dde"}
Oct 30 21:00:11.806367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.806350    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" event={"ID":"0bef2832-cf0e-4334-9d10-0d123781cdb4","Type":"ContainerStarted","Data":"c657655d607d2e227a13496f3696d0dd1978c6b3709b8109f646a2d6a6f773a2"}
Oct 30 21:00:11.830155 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:11.830113    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" podStartSLOduration=1.830095702 podStartE2EDuration="1.830095702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:11.829346786 +0000 UTC m=+1222.688083092" watchObservedRunningTime="2026-10-30 21:00:11.830095702 +0000 UTC m=+1222.688831995"
Oct 30 21:00:12.084695 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:12.084658    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q8xpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:00:12.084841 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:12.084715    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 21:00:12.153048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:12.152406    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:12.161048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:12.158447    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:00:12.161048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:12.158522    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 21:00:12.838252 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:12.838210    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" event={"ID":"172e9bb0-da74-45a8-9bdf-b40f49a91b2b","Type":"ContainerStarted","Data":"8dd1683fb40e6ae6193bb37ca0dc1632efb4c7370f6229442d5ff9d208ea76fe"}
Oct 30 21:00:12.878377 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:12.878321    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98" event={"ID":"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c","Type":"ContainerStarted","Data":"1cd95a27a6461e60a1b24c6d8b5f3d6bba13674e870c4d4be04920f33e18364d"}
Oct 30 21:00:13.124048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.123724    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q8xpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:00:13.124048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.123786    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 21:00:13.124048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.123909    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" podStartSLOduration=3.123893122 podStartE2EDuration="3.123893122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:13.035436756 +0000 UTC m=+1223.894173049" watchObservedRunningTime="2026-10-30 21:00:13.123893122 +0000 UTC m=+1223.982629416"
Oct 30 21:00:13.150927 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.150476    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:00:13.150927 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.150542    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 21:00:13.350205 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.350110    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:13.350669 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.350641    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:00:13.350868 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.350844    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" podUID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 21:00:13.896047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.894235    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"]
Oct 30 21:00:13.900561 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.899801    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:13.903920 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.903765    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"]
Oct 30 21:00:13.931141 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.919051    6048 generic.go:356] "Generic (PLEG): container finished" podID="476fc1eb-7bc7-4cde-9e2d-28e71cbb681c" containerID="1cd95a27a6461e60a1b24c6d8b5f3d6bba13674e870c4d4be04920f33e18364d" exitCode=0
Oct 30 21:00:13.931141 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:13.931110    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98" event={"ID":"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c","Type":"ContainerDied","Data":"1cd95a27a6461e60a1b24c6d8b5f3d6bba13674e870c4d4be04920f33e18364d"}
Oct 30 21:00:14.089049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.088444    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q8xpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:00:14.089049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.088510    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 21:00:14.107045 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.100815    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8s8x\" (UniqueName: \"kubernetes.io/projected/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-kube-api-access-z8s8x\") pod \"maas-api-revoke-sub-dc58cd6d-bclk9\" (UID: \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:14.107045 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.101137    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dc58cd6d-bclk9\" (UID: \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:14.107045 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.101185    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dc58cd6d-bclk9\" (UID: \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:14.150503 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.150410    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:00:14.174302 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.174260    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 21:00:14.215587 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.209130    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8s8x\" (UniqueName: \"kubernetes.io/projected/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-kube-api-access-z8s8x\") pod \"maas-api-revoke-sub-dc58cd6d-bclk9\" (UID: \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:14.215587 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.209373    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dc58cd6d-bclk9\" (UID: \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:14.215587 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.209433    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dc58cd6d-bclk9\" (UID: \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:14.228508 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.228470    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dc58cd6d-bclk9\" (UID: \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:14.234058 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.233662    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8s8x\" (UniqueName: \"kubernetes.io/projected/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-kube-api-access-z8s8x\") pod \"maas-api-revoke-sub-dc58cd6d-bclk9\" (UID: \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:14.234058 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.233940    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dc58cd6d-bclk9\" (UID: \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:14.240444 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.240254    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:14.296767 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.267505    6048 scope.go:122] "RemoveContainer" containerID="8e25818c72536cc9729d8cba408f0771ec4f72f64468e2b184df6cbc498a2bed"
Oct 30 21:00:14.296767 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.268332    6048 scope.go:122] "RemoveContainer" containerID="60d8c22b09573ea45145f3ce9491b8ac3c98141da882738946b6f89712524d33"
Oct 30 21:00:14.436911 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.436313    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:00:14.436911 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.436386    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" podUID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 21:00:14.570085 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.561500    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:14.630099 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.620766    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-kube-api-access-dtrpj\" (UniqueName: \"kubernetes.io/projected/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-kube-api-access-dtrpj\") pod \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\" (UID: \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\") "
Oct 30 21:00:14.630099 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.620969    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-openshift-ca\") pod \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\" (UID: \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\") "
Oct 30 21:00:14.630099 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.621065    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-xks-ca\") pod \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\" (UID: \"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c\") "
Oct 30 21:00:14.630099 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.624670    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-xks-ca" pod "476fc1eb-7bc7-4cde-9e2d-28e71cbb681c" (UID: "476fc1eb-7bc7-4cde-9e2d-28e71cbb681c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:14.630099 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.627087    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-kube-api-access-dtrpj" pod "476fc1eb-7bc7-4cde-9e2d-28e71cbb681c" (UID: "476fc1eb-7bc7-4cde-9e2d-28e71cbb681c"). InnerVolumeSpecName "kube-api-access-dtrpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:14.630099 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.627426    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-openshift-ca" pod "476fc1eb-7bc7-4cde-9e2d-28e71cbb681c" (UID: "476fc1eb-7bc7-4cde-9e2d-28e71cbb681c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:14.728313 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.728072    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:14.728313 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.728108    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:14.728313 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:14.728126    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtrpj\" (UniqueName: \"kubernetes.io/projected/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c-kube-api-access-dtrpj\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:15.039294 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:15.039223    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"
Oct 30 21:00:15.039751 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:15.039212    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98" event={"ID":"476fc1eb-7bc7-4cde-9e2d-28e71cbb681c","Type":"ContainerDied","Data":"5124d74b89545c63bb4c44ff8cfa10354a1df70e7f28ca92f0a9d8cae14f6b51"}
Oct 30 21:00:15.039836 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:15.039795    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5124d74b89545c63bb4c44ff8cfa10354a1df70e7f28ca92f0a9d8cae14f6b51"
Oct 30 21:00:15.098707 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:15.096637    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q8xpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:00:15.098707 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:15.096713    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 21:00:15.123160 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:15.123120    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod272bbc3d_59d4_41ac_b7c4_0bb71f2e7327.slice/crio-29252c8ab9d0802514bc164e03c77624ca03a4bbad17275bb92f82e0716ca66d WatchSource:0}: Error finding container 29252c8ab9d0802514bc164e03c77624ca03a4bbad17275bb92f82e0716ca66d: Status 404 returned error can't find the container with id 29252c8ab9d0802514bc164e03c77624ca03a4bbad17275bb92f82e0716ca66d
Oct 30 21:00:15.124873 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:15.124647    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"]
Oct 30 21:00:15.166368 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:15.165901    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:00:15.166368 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:15.165971    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 21:00:15.320429 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:15.296595    6048 scope.go:122] "RemoveContainer" containerID="eaedff4601c329f0b86f991fa577bc566e32baf8ead07e94d9e186d41cbd348d"
Oct 30 21:00:15.420063 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:15.419292    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:00:15.420063 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:15.419354    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" podUID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 21:00:16.099540 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.098866    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q8xpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:00:16.099540 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.098943    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 21:00:16.133560 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.133529    6048 generic.go:356] "Generic (PLEG): container finished" podID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" containerID="8f12c4ba64198297f427408d5270f8975e230ad3c5527fef323fbdfea945ec40" exitCode=60
Oct 30 21:00:16.133703 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.133613    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445" event={"ID":"ee9767f2-13a4-4175-bea8-72f1d239a2e2","Type":"ContainerDied","Data":"8f12c4ba64198297f427408d5270f8975e230ad3c5527fef323fbdfea945ec40"}
Oct 30 21:00:16.133703 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.133658    6048 scope.go:122] "RemoveContainer" containerID="8e25818c72536cc9729d8cba408f0771ec4f72f64468e2b184df6cbc498a2bed"
Oct 30 21:00:16.134100 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.134085    6048 scope.go:122] "RemoveContainer" containerID="8f12c4ba64198297f427408d5270f8975e230ad3c5527fef323fbdfea945ec40"
Oct 30 21:00:16.134406 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:00:16.134386    6048 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445_odh-ai-gateway-infra(ee9767f2-13a4-4175-bea8-72f1d239a2e2)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2"
Oct 30 21:00:16.137743 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.137718    6048 generic.go:356] "Generic (PLEG): container finished" podID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" containerID="a4283fe8619025dd8e441b6a99aba5cfc7abf510bd322fc5b498f5d39acc4f80" exitCode=60
Oct 30 21:00:16.137860 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.137747    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v" event={"ID":"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb","Type":"ContainerDied","Data":"a4283fe8619025dd8e441b6a99aba5cfc7abf510bd322fc5b498f5d39acc4f80"}
Oct 30 21:00:16.138277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.138245    6048 scope.go:122] "RemoveContainer" containerID="a4283fe8619025dd8e441b6a99aba5cfc7abf510bd322fc5b498f5d39acc4f80"
Oct 30 21:00:16.138625 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:00:16.138585    6048 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v_odh-ai-gateway-infra(72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb"
Oct 30 21:00:16.233944 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.232221    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:00:16.233944 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.232280    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 21:00:16.237199 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.237156    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg" event={"ID":"02f60cab-56f8-4e8a-ad41-f3d21c65072f","Type":"ContainerStarted","Data":"c9b74c335e175b9eb3c727bb4c589505ef193e5dfd8c17a3b5e2aeac0207325e"}
Oct 30 21:00:16.241096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.241062    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9" event={"ID":"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327","Type":"ContainerStarted","Data":"7ac2eff6dfdcac5be402840b68e6e26e99c3e9fcfafe4ad74aa98e05c1c307b3"}
Oct 30 21:00:16.241228 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.241118    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9" event={"ID":"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327","Type":"ContainerStarted","Data":"29252c8ab9d0802514bc164e03c77624ca03a4bbad17275bb92f82e0716ca66d"}
Oct 30 21:00:16.277048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.273244    6048 scope.go:122] "RemoveContainer" containerID="60d8c22b09573ea45145f3ce9491b8ac3c98141da882738946b6f89712524d33"
Oct 30 21:00:16.388109 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.364143    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:00:16.388109 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.364209    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" podUID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 21:00:16.412298 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:16.412235    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9" podStartSLOduration=3.412212598 podStartE2EDuration="3.412212598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:16.364733206 +0000 UTC m=+1227.223469503" watchObservedRunningTime="2026-10-30 21:00:16.412212598 +0000 UTC m=+1227.270948892"
Oct 30 21:00:16.920106 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:00:16.913265    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:00:17.088481 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.088441    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q8xpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:00:17.088761 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.088728    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 21:00:17.170080 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.152609    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:00:17.213355 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.213256    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 21:00:17.218104 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.218069    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"]
Oct 30 21:00:17.328368 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.328332    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"]
Oct 30 21:00:17.328533 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.328399    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"]
Oct 30 21:00:17.330182 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.330156    6048 generic.go:356] "Generic (PLEG): container finished" podID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" containerID="c9b74c335e175b9eb3c727bb4c589505ef193e5dfd8c17a3b5e2aeac0207325e" exitCode=60
Oct 30 21:00:17.330299 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.330282    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg" event={"ID":"02f60cab-56f8-4e8a-ad41-f3d21c65072f","Type":"ContainerDied","Data":"c9b74c335e175b9eb3c727bb4c589505ef193e5dfd8c17a3b5e2aeac0207325e"}
Oct 30 21:00:17.330380 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.330328    6048 scope.go:122] "RemoveContainer" containerID="eaedff4601c329f0b86f991fa577bc566e32baf8ead07e94d9e186d41cbd348d"
Oct 30 21:00:17.337620 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.334150    6048 generic.go:356] "Generic (PLEG): container finished" podID="272bbc3d-59d4-41ac-b7c4-0bb71f2e7327" containerID="7ac2eff6dfdcac5be402840b68e6e26e99c3e9fcfafe4ad74aa98e05c1c307b3" exitCode=0
Oct 30 21:00:17.337620 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.334357    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9" event={"ID":"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327","Type":"ContainerDied","Data":"7ac2eff6dfdcac5be402840b68e6e26e99c3e9fcfafe4ad74aa98e05c1c307b3"}
Oct 30 21:00:17.362210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.349468    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:00:17.362210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:17.349522    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" podUID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 21:00:18.085706 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.085633    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q8xpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:00:18.085706 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.085688    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 21:00:18.093387 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.093345    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"
Oct 30 21:00:18.094816 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.094795    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/02f60cab-56f8-4e8a-ad41-f3d21c65072f-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02f60cab-56f8-4e8a-ad41-f3d21c65072f-maas-api-service-ca\") pod \"02f60cab-56f8-4e8a-ad41-f3d21c65072f\" (UID: \"02f60cab-56f8-4e8a-ad41-f3d21c65072f\") "
Oct 30 21:00:18.094921 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.094904    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/02f60cab-56f8-4e8a-ad41-f3d21c65072f-kube-api-access-pshfp\" (UniqueName: \"kubernetes.io/projected/02f60cab-56f8-4e8a-ad41-f3d21c65072f-kube-api-access-pshfp\") pod \"02f60cab-56f8-4e8a-ad41-f3d21c65072f\" (UID: \"02f60cab-56f8-4e8a-ad41-f3d21c65072f\") "
Oct 30 21:00:18.095211 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.095186    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02f60cab-56f8-4e8a-ad41-f3d21c65072f-maas-api-service-ca" pod "02f60cab-56f8-4e8a-ad41-f3d21c65072f" (UID: "02f60cab-56f8-4e8a-ad41-f3d21c65072f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:18.095568 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.095550    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02f60cab-56f8-4e8a-ad41-f3d21c65072f-maas-api-service-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:18.097332 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.097304    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02f60cab-56f8-4e8a-ad41-f3d21c65072f-kube-api-access-pshfp" pod "02f60cab-56f8-4e8a-ad41-f3d21c65072f" (UID: "02f60cab-56f8-4e8a-ad41-f3d21c65072f"). InnerVolumeSpecName "kube-api-access-pshfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:18.136213 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.136182    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"
Oct 30 21:00:18.142231 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.141526    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"
Oct 30 21:00:18.152406 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.152374    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:00:18.152631 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.152601    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Oct 30 21:00:18.218605 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.218559    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee9767f2-13a4-4175-bea8-72f1d239a2e2-kube-api-access-h8vbh\" (UniqueName: \"kubernetes.io/projected/ee9767f2-13a4-4175-bea8-72f1d239a2e2-kube-api-access-h8vbh\") pod \"ee9767f2-13a4-4175-bea8-72f1d239a2e2\" (UID: \"ee9767f2-13a4-4175-bea8-72f1d239a2e2\") "
Oct 30 21:00:18.218985 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.218624    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-kube-api-access-w727n\" (UniqueName: \"kubernetes.io/projected/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-kube-api-access-w727n\") pod \"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb\" (UID: \"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb\") "
Oct 30 21:00:18.218985 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.218750    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-maas-api-service-ca\") pod \"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb\" (UID: \"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb\") "
Oct 30 21:00:18.218985 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.218822    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee9767f2-13a4-4175-bea8-72f1d239a2e2-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee9767f2-13a4-4175-bea8-72f1d239a2e2-maas-api-service-ca\") pod \"ee9767f2-13a4-4175-bea8-72f1d239a2e2\" (UID: \"ee9767f2-13a4-4175-bea8-72f1d239a2e2\") "
Oct 30 21:00:18.219358 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.219333    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pshfp\" (UniqueName: \"kubernetes.io/projected/02f60cab-56f8-4e8a-ad41-f3d21c65072f-kube-api-access-pshfp\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:18.219805 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.219778    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-maas-api-service-ca" pod "72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" (UID: "72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:18.219984 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.219952    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee9767f2-13a4-4175-bea8-72f1d239a2e2-maas-api-service-ca" pod "ee9767f2-13a4-4175-bea8-72f1d239a2e2" (UID: "ee9767f2-13a4-4175-bea8-72f1d239a2e2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:18.221602 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.221579    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee9767f2-13a4-4175-bea8-72f1d239a2e2-kube-api-access-h8vbh" pod "ee9767f2-13a4-4175-bea8-72f1d239a2e2" (UID: "ee9767f2-13a4-4175-bea8-72f1d239a2e2"). InnerVolumeSpecName "kube-api-access-h8vbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:18.223220 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.223197    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-kube-api-access-w727n" pod "72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" (UID: "72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb"). InnerVolumeSpecName "kube-api-access-w727n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:18.320438 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.320408    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8vbh\" (UniqueName: \"kubernetes.io/projected/ee9767f2-13a4-4175-bea8-72f1d239a2e2-kube-api-access-h8vbh\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:18.320438 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.320436    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w727n\" (UniqueName: \"kubernetes.io/projected/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-kube-api-access-w727n\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:18.320438 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.320447    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb-maas-api-service-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:18.320668 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.320459    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee9767f2-13a4-4175-bea8-72f1d239a2e2-maas-api-service-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:18.349496 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.349406    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:00:18.349742 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.349713    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" podUID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 30 21:00:18.352707 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.352677    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v" event={"ID":"72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb","Type":"ContainerDied","Data":"5c233fed264be24896bbf5f1500ba68402f7f7c9d93f1ade2e71bbe5592ac3f9"}
Oct 30 21:00:18.352899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.352885    6048 scope.go:122] "RemoveContainer" containerID="a4283fe8619025dd8e441b6a99aba5cfc7abf510bd322fc5b498f5d39acc4f80"
Oct 30 21:00:18.353159 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.353141    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"
Oct 30 21:00:18.359295 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.359264    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg" event={"ID":"02f60cab-56f8-4e8a-ad41-f3d21c65072f","Type":"ContainerDied","Data":"da8f5cac9baf61bb6095fcbcec07c2e85831bceba1ec63b8af0ae7131a604f8d"}
Oct 30 21:00:18.359599 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.359580    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"
Oct 30 21:00:18.365133 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.365108    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"
Oct 30 21:00:18.375095 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.372897    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445" event={"ID":"ee9767f2-13a4-4175-bea8-72f1d239a2e2","Type":"ContainerDied","Data":"e7a5b53d191894486fa9cdd31527b656161cf85e30d79932a80771337e109985"}
Oct 30 21:00:18.387695 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.387666    6048 scope.go:122] "RemoveContainer" containerID="c9b74c335e175b9eb3c727bb4c589505ef193e5dfd8c17a3b5e2aeac0207325e"
Oct 30 21:00:18.404741 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.404717    6048 scope.go:122] "RemoveContainer" containerID="8f12c4ba64198297f427408d5270f8975e230ad3c5527fef323fbdfea945ec40"
Oct 30 21:00:18.416259 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.416232    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"]
Oct 30 21:00:18.421882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.421811    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c2d1eb-29889900-89q8v"]
Oct 30 21:00:18.438510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.438464    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"]
Oct 30 21:00:18.441562 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.441533    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-4a0c5b-29889900-r2445"]
Oct 30 21:00:18.478173 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.478129    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"]
Oct 30 21:00:18.481095 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.481068    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889900-n62gg"]
Oct 30 21:00:18.620122 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.615694    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:18.728592 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.728552    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-kube-api-access-z8s8x\" (UniqueName: \"kubernetes.io/projected/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-kube-api-access-z8s8x\") pod \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\" (UID: \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\") "
Oct 30 21:00:18.728946 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.728916    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-openshift-ca\") pod \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\" (UID: \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\") "
Oct 30 21:00:18.729086 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.729000    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-xks-ca\") pod \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\" (UID: \"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327\") "
Oct 30 21:00:18.729357 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.729328    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-openshift-ca" pod "272bbc3d-59d4-41ac-b7c4-0bb71f2e7327" (UID: "272bbc3d-59d4-41ac-b7c4-0bb71f2e7327"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:18.729657 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.729631    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:18.730828 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.730801    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-kube-api-access-z8s8x" pod "272bbc3d-59d4-41ac-b7c4-0bb71f2e7327" (UID: "272bbc3d-59d4-41ac-b7c4-0bb71f2e7327"). InnerVolumeSpecName "kube-api-access-z8s8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:18.731589 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.731555    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-xks-ca" pod "272bbc3d-59d4-41ac-b7c4-0bb71f2e7327" (UID: "272bbc3d-59d4-41ac-b7c4-0bb71f2e7327"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:18.831329 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.831289    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8s8x\" (UniqueName: \"kubernetes.io/projected/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-kube-api-access-z8s8x\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:18.831329 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:18.831330    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:19.084523 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.084479    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q8xpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:00:19.084738 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.084549    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 30 21:00:19.155054 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.155009    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:19.155551 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.155526    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:19.156665 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.156643    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:00:19.285170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.285087    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" path="/var/lib/kubelet/pods/02f60cab-56f8-4e8a-ad41-f3d21c65072f/volumes"
Oct 30 21:00:19.286497 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.286424    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" path="/var/lib/kubelet/pods/72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb/volumes"
Oct 30 21:00:19.287284 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.287253    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" path="/var/lib/kubelet/pods/ee9767f2-13a4-4175-bea8-72f1d239a2e2/volumes"
Oct 30 21:00:19.377507 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.377392    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"
Oct 30 21:00:19.377507 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.377423    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9" event={"ID":"272bbc3d-59d4-41ac-b7c4-0bb71f2e7327","Type":"ContainerDied","Data":"29252c8ab9d0802514bc164e03c77624ca03a4bbad17275bb92f82e0716ca66d"}
Oct 30 21:00:19.377507 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.377473    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29252c8ab9d0802514bc164e03c77624ca03a4bbad17275bb92f82e0716ca66d"
Oct 30 21:00:19.554549 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.554436    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:19.555325 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.555297    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:19.556276 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:19.556257    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:00:20.108160 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:20.108126    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:20.108651 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:20.108629    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:20.110133 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:20.110111    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:00:21.180349 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180318    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"]
Oct 30 21:00:21.180893 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180879    6048 cpu_manager.go:414] "containerMap: removing container" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" containerName="cleanup"
Oct 30 21:00:21.180938 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180894    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" containerName="cleanup"
Oct 30 21:00:21.180938 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180905    6048 cpu_manager.go:414] "containerMap: removing container" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" containerName="cleanup"
Oct 30 21:00:21.180938 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180910    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" containerName="cleanup"
Oct 30 21:00:21.180938 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180924    6048 cpu_manager.go:414] "containerMap: removing container" podUID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" containerName="cleanup"
Oct 30 21:00:21.180938 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180929    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" containerName="cleanup"
Oct 30 21:00:21.181129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180941    6048 cpu_manager.go:414] "containerMap: removing container" podUID="272bbc3d-59d4-41ac-b7c4-0bb71f2e7327" containerName="revoke-keys"
Oct 30 21:00:21.181129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180946    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="272bbc3d-59d4-41ac-b7c4-0bb71f2e7327" containerName="revoke-keys"
Oct 30 21:00:21.181129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180956    6048 cpu_manager.go:414] "containerMap: removing container" podUID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" containerName="cleanup"
Oct 30 21:00:21.181129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180961    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" containerName="cleanup"
Oct 30 21:00:21.181129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180972    6048 cpu_manager.go:414] "containerMap: removing container" podUID="476fc1eb-7bc7-4cde-9e2d-28e71cbb681c" containerName="revoke-keys"
Oct 30 21:00:21.181129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180977    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="476fc1eb-7bc7-4cde-9e2d-28e71cbb681c" containerName="revoke-keys"
Oct 30 21:00:21.181129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180986    6048 cpu_manager.go:414] "containerMap: removing container" podUID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" containerName="cleanup"
Oct 30 21:00:21.181129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180990    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" containerName="cleanup"
Oct 30 21:00:21.181129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.180999    6048 cpu_manager.go:414] "containerMap: removing container" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" containerName="cleanup"
Oct 30 21:00:21.181129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181003    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" containerName="cleanup"
Oct 30 21:00:21.181129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181015    6048 cpu_manager.go:414] "containerMap: removing container" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" containerName="cleanup"
Oct 30 21:00:21.181129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181033    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" containerName="cleanup"
Oct 30 21:00:21.181463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181135    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" containerName="cleanup"
Oct 30 21:00:21.181463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181145    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" containerName="cleanup"
Oct 30 21:00:21.181463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181151    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" containerName="cleanup"
Oct 30 21:00:21.181463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181159    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="272bbc3d-59d4-41ac-b7c4-0bb71f2e7327" containerName="revoke-keys"
Oct 30 21:00:21.181463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181166    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" containerName="cleanup"
Oct 30 21:00:21.181463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181172    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="476fc1eb-7bc7-4cde-9e2d-28e71cbb681c" containerName="revoke-keys"
Oct 30 21:00:21.181463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181179    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" containerName="cleanup"
Oct 30 21:00:21.181463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181186    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" containerName="cleanup"
Oct 30 21:00:21.181463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181192    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" containerName="cleanup"
Oct 30 21:00:21.181463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.181199    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" containerName="cleanup"
Oct 30 21:00:21.186212 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.186194    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:21.191757 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.191735    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:00:21.191894 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.191777    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:00:21.196159 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.196134    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"]
Oct 30 21:00:21.274598 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.274561    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-86184318-g2jhb\" (UID: \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:21.274765 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.274617    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-86184318-g2jhb\" (UID: \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:21.274809 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.274786    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzm6s\" (UniqueName: \"kubernetes.io/projected/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-kube-api-access-wzm6s\") pod \"maas-api-revoke-sub-86184318-g2jhb\" (UID: \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:21.376644 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.376604    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-86184318-g2jhb\" (UID: \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:21.376845 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.376677    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-86184318-g2jhb\" (UID: \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:21.376990 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.376959    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzm6s\" (UniqueName: \"kubernetes.io/projected/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-kube-api-access-wzm6s\") pod \"maas-api-revoke-sub-86184318-g2jhb\" (UID: \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:21.377438 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.377418    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-86184318-g2jhb\" (UID: \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:21.379261 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.379237    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-86184318-g2jhb\" (UID: \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:21.391511 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.391488    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzm6s\" (UniqueName: \"kubernetes.io/projected/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-kube-api-access-wzm6s\") pod \"maas-api-revoke-sub-86184318-g2jhb\" (UID: \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:21.502420 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.502342    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:21.784902 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:21.784869    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"]
Oct 30 21:00:21.785859 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:21.785832    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2599170e_31fb_4be9_ad82_2d6b5ec96d5e.slice/crio-0e236e4fe047ad65f61e2537a0fa66bca6573d25add962d96e19c05774592371 WatchSource:0}: Error finding container 0e236e4fe047ad65f61e2537a0fa66bca6573d25add962d96e19c05774592371: Status 404 returned error can't find the container with id 0e236e4fe047ad65f61e2537a0fa66bca6573d25add962d96e19c05774592371
Oct 30 21:00:22.404434 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:22.404398    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb" event={"ID":"2599170e-31fb-4be9-ad82-2d6b5ec96d5e","Type":"ContainerStarted","Data":"379e3a11263aa2248c964299cbba1ab398b234594b5b2935a0ed9a29c42c7fe1"}
Oct 30 21:00:22.404793 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:22.404454    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb" event={"ID":"2599170e-31fb-4be9-ad82-2d6b5ec96d5e","Type":"ContainerStarted","Data":"0e236e4fe047ad65f61e2537a0fa66bca6573d25add962d96e19c05774592371"}
Oct 30 21:00:22.425059 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:22.424987    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb" podStartSLOduration=1.4249742699999999 podStartE2EDuration="1.42497427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:22.42336233 +0000 UTC m=+1233.282098623" watchObservedRunningTime="2026-10-30 21:00:22.42497427 +0000 UTC m=+1233.283710562"
Oct 30 21:00:23.412291 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:23.412255    6048 generic.go:356] "Generic (PLEG): container finished" podID="2599170e-31fb-4be9-ad82-2d6b5ec96d5e" containerID="379e3a11263aa2248c964299cbba1ab398b234594b5b2935a0ed9a29c42c7fe1" exitCode=0
Oct 30 21:00:23.412885 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:23.412359    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb" event={"ID":"2599170e-31fb-4be9-ad82-2d6b5ec96d5e","Type":"ContainerDied","Data":"379e3a11263aa2248c964299cbba1ab398b234594b5b2935a0ed9a29c42c7fe1"}
Oct 30 21:00:24.574118 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:24.574088    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:24.719287 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:24.719197    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-kube-api-access-wzm6s\" (UniqueName: \"kubernetes.io/projected/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-kube-api-access-wzm6s\") pod \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\" (UID: \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\") "
Oct 30 21:00:24.719287 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:24.719249    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-openshift-ca\") pod \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\" (UID: \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\") "
Oct 30 21:00:24.719287 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:24.719281    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-xks-ca\") pod \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\" (UID: \"2599170e-31fb-4be9-ad82-2d6b5ec96d5e\") "
Oct 30 21:00:24.720415 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:24.720386    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-openshift-ca" pod "2599170e-31fb-4be9-ad82-2d6b5ec96d5e" (UID: "2599170e-31fb-4be9-ad82-2d6b5ec96d5e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:24.721873 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:24.721849    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-xks-ca" pod "2599170e-31fb-4be9-ad82-2d6b5ec96d5e" (UID: "2599170e-31fb-4be9-ad82-2d6b5ec96d5e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:24.722512 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:24.722494    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-kube-api-access-wzm6s" pod "2599170e-31fb-4be9-ad82-2d6b5ec96d5e" (UID: "2599170e-31fb-4be9-ad82-2d6b5ec96d5e"). InnerVolumeSpecName "kube-api-access-wzm6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:24.820754 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:24.820720    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzm6s\" (UniqueName: \"kubernetes.io/projected/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-kube-api-access-wzm6s\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:24.820754 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:24.820752    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:24.820923 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:24.820765    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2599170e-31fb-4be9-ad82-2d6b5ec96d5e-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:00:25.427569 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:25.427540    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"
Oct 30 21:00:25.427569 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:25.427542    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb" event={"ID":"2599170e-31fb-4be9-ad82-2d6b5ec96d5e","Type":"ContainerDied","Data":"0e236e4fe047ad65f61e2537a0fa66bca6573d25add962d96e19c05774592371"}
Oct 30 21:00:25.427742 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:25.427613    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e236e4fe047ad65f61e2537a0fa66bca6573d25add962d96e19c05774592371"
Oct 30 21:00:33.400005 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.399973    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"]
Oct 30 21:00:33.400829 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.400806    6048 cpu_manager.go:414] "containerMap: removing container" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" containerName="cleanup"
Oct 30 21:00:33.400933 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.400830    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee9767f2-13a4-4175-bea8-72f1d239a2e2" containerName="cleanup"
Oct 30 21:00:33.400933 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.400845    6048 cpu_manager.go:414] "containerMap: removing container" podUID="2599170e-31fb-4be9-ad82-2d6b5ec96d5e" containerName="revoke-keys"
Oct 30 21:00:33.400933 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.400852    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2599170e-31fb-4be9-ad82-2d6b5ec96d5e" containerName="revoke-keys"
Oct 30 21:00:33.400933 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.400887    6048 cpu_manager.go:414] "containerMap: removing container" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" containerName="cleanup"
Oct 30 21:00:33.400933 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.400895    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72e411e3-ee77-4c3c-9d7f-7cdc75ab49eb" containerName="cleanup"
Oct 30 21:00:33.401220 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.401039    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="02f60cab-56f8-4e8a-ad41-f3d21c65072f" containerName="cleanup"
Oct 30 21:00:33.401220 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.401064    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="2599170e-31fb-4be9-ad82-2d6b5ec96d5e" containerName="revoke-keys"
Oct 30 21:00:33.404928 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.404906    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.413359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.413332    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c2d1eb\"/\"distinct-w4-c2d1eb-kserve-self-signed-certs\""
Oct 30 21:00:33.415474 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.415448    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"]
Oct 30 21:00:33.594982 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.594940    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-tmp-dir\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.595173 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.595116    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-dshm\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.595309 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.595279    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0dadee7-bff2-46b1-bcda-3d3153699577-tls-certs\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.595366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.595342    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5njq\" (UniqueName: \"kubernetes.io/projected/c0dadee7-bff2-46b1-bcda-3d3153699577-kube-api-access-h5njq\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.595465 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.595447    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-home\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.595535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.595477    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-model-cache\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.697160 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.697079    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-dshm\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.697321 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.697207    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0dadee7-bff2-46b1-bcda-3d3153699577-tls-certs\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.697321 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.697242    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5njq\" (UniqueName: \"kubernetes.io/projected/c0dadee7-bff2-46b1-bcda-3d3153699577-kube-api-access-h5njq\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.697444 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.697322    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-home\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.697444 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.697346    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-model-cache\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.697444 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.697412    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-tmp-dir\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.697840 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.697811    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-tmp-dir\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.697981 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.697877    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-home\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.698169 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.698147    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-model-cache\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.699826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.699787    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-dshm\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.700067 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.700018    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0dadee7-bff2-46b1-bcda-3d3153699577-tls-certs\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.712494 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.712454    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5njq\" (UniqueName: \"kubernetes.io/projected/c0dadee7-bff2-46b1-bcda-3d3153699577-kube-api-access-h5njq\") pod \"distinct-w4-c2d1eb-kserve-c874cdf48-62hdw\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") " pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:33.718312 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:33.718285    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:34.006222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:34.006193    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"]
Oct 30 21:00:34.007324 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:34.007298    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0dadee7_bff2_46b1_bcda_3d3153699577.slice/crio-5140265c4e81b5206ad5918f2ca4f1e5b1f8e0fd5cd249af99e4fcfacb80a87a WatchSource:0}: Error finding container 5140265c4e81b5206ad5918f2ca4f1e5b1f8e0fd5cd249af99e4fcfacb80a87a: Status 404 returned error can't find the container with id 5140265c4e81b5206ad5918f2ca4f1e5b1f8e0fd5cd249af99e4fcfacb80a87a
Oct 30 21:00:34.511208 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:34.511161    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" event={"ID":"c0dadee7-bff2-46b1-bcda-3d3153699577","Type":"ContainerStarted","Data":"0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe"}
Oct 30 21:00:34.511208 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:34.511207    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" event={"ID":"c0dadee7-bff2-46b1-bcda-3d3153699577","Type":"ContainerStarted","Data":"5140265c4e81b5206ad5918f2ca4f1e5b1f8e0fd5cd249af99e4fcfacb80a87a"}
Oct 30 21:00:34.531853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:34.531801    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podStartSLOduration=1.531787212 podStartE2EDuration="1.531787212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:34.52952186 +0000 UTC m=+1245.388258132" watchObservedRunningTime="2026-10-30 21:00:34.531787212 +0000 UTC m=+1245.390523504"
Oct 30 21:00:34.718705 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:34.718674    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:36.915055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:36.913133    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"]
Oct 30 21:00:36.956046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:36.949230    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"]
Oct 30 21:00:36.956046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:36.949351    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:36.981048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:36.974234    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-c4b379\"/\"openshift-service-ca.crt\""
Oct 30 21:00:36.981048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:36.974344    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-c4b379\"/\"default-dockercfg-b99dh\""
Oct 30 21:00:36.981048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:36.974412    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-c4b379\"/\"distinct-w1-c4b379-kserve-self-signed-certs\""
Oct 30 21:00:36.981048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:36.974476    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-c4b379\"/\"kube-root-ca.crt\""
Oct 30 21:00:37.101050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.084425    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzk4v\" (UniqueName: \"kubernetes.io/projected/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-kube-api-access-bzk4v\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.101050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.084536    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-model-cache\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.101050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.084566    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tls-certs\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.101050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.084639    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-dshm\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.101050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.084688    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-home\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.101050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.084728    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tmp-dir\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.200009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.198603    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzk4v\" (UniqueName: \"kubernetes.io/projected/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-kube-api-access-bzk4v\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.200009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.198710    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-model-cache\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.200009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.198737    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tls-certs\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.200009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.198807    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-dshm\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.200009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.198855    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-home\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.200009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.198896    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tmp-dir\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.200009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.199532    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tmp-dir\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.200009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.199920    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-model-cache\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.200570 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.200206    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-home\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.356690 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.356614    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-dshm\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.384828 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.384758    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzk4v\" (UniqueName: \"kubernetes.io/projected/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-kube-api-access-bzk4v\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.400389 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.390612    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tls-certs\") pod \"distinct-w1-c4b379-kserve-84b889547b-tmfzs\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") " pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:37.566114 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:37.566081    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:38.020406 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:38.020376    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"]
Oct 30 21:00:38.021461 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:38.021431    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1117c12d_3aba_40d8_a4b0_0c7aa9a19d27.slice/crio-43a72d75c7b330de52f1383eee14d5cea7c2ddd95a82980e0448e2866ef21dfa WatchSource:0}: Error finding container 43a72d75c7b330de52f1383eee14d5cea7c2ddd95a82980e0448e2866ef21dfa: Status 404 returned error can't find the container with id 43a72d75c7b330de52f1383eee14d5cea7c2ddd95a82980e0448e2866ef21dfa
Oct 30 21:00:38.566706 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:38.566627    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" event={"ID":"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27","Type":"ContainerStarted","Data":"5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e"}
Oct 30 21:00:38.566706 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:38.566700    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" event={"ID":"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27","Type":"ContainerStarted","Data":"43a72d75c7b330de52f1383eee14d5cea7c2ddd95a82980e0448e2866ef21dfa"}
Oct 30 21:00:38.567994 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:38.567973    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:38.589806 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:38.589753    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podStartSLOduration=2.589741148 podStartE2EDuration="2.589741148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:38.586915921 +0000 UTC m=+1249.445652209" watchObservedRunningTime="2026-10-30 21:00:38.589741148 +0000 UTC m=+1249.448477483"
Oct 30 21:00:43.719374 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:43.719333    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:43.732094 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:43.732063    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:44.352384 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.352348    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"]
Oct 30 21:00:44.358404 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.358372    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.371062 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.367166    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-4a0c5b\"/\"distinct-2-w0-4a0c5b-kserve-self-signed-certs\""
Oct 30 21:00:44.377498 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.373039    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"]
Oct 30 21:00:44.455509 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.455469    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-model-cache\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.455700 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.455574    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkslz\" (UniqueName: \"kubernetes.io/projected/5f013308-5885-4d09-8947-6bbd783fba1b-kube-api-access-rkslz\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.455700 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.455617    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-tmp-dir\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.455700 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.455681    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f013308-5885-4d09-8947-6bbd783fba1b-tls-certs\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.455875 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.455837    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-home\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.455932 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.455887    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-dshm\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.560322 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.560283    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-home\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.560535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.560352    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-dshm\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.560535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.560469    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-model-cache\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.560676 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.560541    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkslz\" (UniqueName: \"kubernetes.io/projected/5f013308-5885-4d09-8947-6bbd783fba1b-kube-api-access-rkslz\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.560676 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.560582    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-tmp-dir\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.560676 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.560607    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f013308-5885-4d09-8947-6bbd783fba1b-tls-certs\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.561183 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.561157    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-tmp-dir\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.561531 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.561506    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-model-cache\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.561767 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.561743    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-home\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.563844 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.563810    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-dshm\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.565511 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.565487    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f013308-5885-4d09-8947-6bbd783fba1b-tls-certs\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.573605 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.573568    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkslz\" (UniqueName: \"kubernetes.io/projected/5f013308-5885-4d09-8947-6bbd783fba1b-kube-api-access-rkslz\") pod \"distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") " pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.621805 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.621720    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:00:44.684944 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.684904    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:44.967113 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:44.967083    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"]
Oct 30 21:00:44.969014 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:44.968984    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f013308_5885_4d09_8947_6bbd783fba1b.slice/crio-d434a5db769c648dd760ab84eb02664e87f620c0ca1c366df64c6805251fad9b WatchSource:0}: Error finding container d434a5db769c648dd760ab84eb02664e87f620c0ca1c366df64c6805251fad9b: Status 404 returned error can't find the container with id d434a5db769c648dd760ab84eb02664e87f620c0ca1c366df64c6805251fad9b
Oct 30 21:00:45.619638 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:45.619598    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" event={"ID":"5f013308-5885-4d09-8947-6bbd783fba1b","Type":"ContainerStarted","Data":"932fae69af880a90763f428ed8770e68957310fa77f8ecffee1f69da2d7133a6"}
Oct 30 21:00:45.619839 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:45.619648    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" event={"ID":"5f013308-5885-4d09-8947-6bbd783fba1b","Type":"ContainerStarted","Data":"d434a5db769c648dd760ab84eb02664e87f620c0ca1c366df64c6805251fad9b"}
Oct 30 21:00:45.641078 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:45.641015    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podStartSLOduration=1.6410008619999998 podStartE2EDuration="1.641000862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:45.639248476 +0000 UTC m=+1256.497984789" watchObservedRunningTime="2026-10-30 21:00:45.641000862 +0000 UTC m=+1256.499737155"
Oct 30 21:00:45.685183 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:45.685152    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:46.802372 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:00:46.802329    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:00:47.567337 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:47.567293    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:47.580875 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:47.580846    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:47.644331 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:47.644300    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:00:49.786117 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.786004    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"]
Oct 30 21:00:49.796968 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.796938    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.807392 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.807364    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 21:00:49.811094 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.810294    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 21:00:49.811276 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.810468    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fnh57\""
Oct 30 21:00:49.820857 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.820822    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.821193 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.821169    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.821412 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.821396    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.821553 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.821533    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz7pl\" (UniqueName: \"kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-kube-api-access-rz7pl\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.821712 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.821696    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.821975 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.821954    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.832602 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.832565    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.851115 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.841940    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"]
Oct 30 21:00:49.929055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.905283    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 21:00:49.981049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.977098    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.981049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.977289    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.981049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.977341    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz7pl\" (UniqueName: \"kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-kube-api-access-rz7pl\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.981049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.977449    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.981049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.977528    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.981049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.977571    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.981049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.977647    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:49.981049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:49.978752    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:50.159890 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:50.159851    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:50.307316 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:50.307171    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz7pl\" (UniqueName: \"kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-kube-api-access-rz7pl\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:50.308040 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:50.307999    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:50.313778 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:50.313725    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:50.331625 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:50.331390    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:50.332783 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:50.332722    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xfgxl\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:50.385297 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:50.385260    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:51.060618 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:51.052770    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"]
Oct 30 21:00:51.840105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:51.840065    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl" event={"ID":"b9c62600-17d3-4ad2-a58f-b5579d5c8d63","Type":"ContainerStarted","Data":"347b8fa402e73f31c5bf89b50ab064be6a76e75f2689a1c1a14b54a71c09389a"}
Oct 30 21:00:54.427429 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:54.427397    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:54.427708 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:54.427463    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:54.685206 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:54.685105    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:54.699749 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:54.699719    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:54.868877 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:54.868837    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl" event={"ID":"b9c62600-17d3-4ad2-a58f-b5579d5c8d63","Type":"ContainerStarted","Data":"8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d"}
Oct 30 21:00:54.869070 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:54.868922    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:54.889752 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:54.889703    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:00:54.941793 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:54.941676    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl" podStartSLOduration=2.601385797 podStartE2EDuration="5.941654103s" totalImagesPullingTime="3.340268306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:54.897664858 +0000 UTC m=+1265.756401162" watchObservedRunningTime="2026-10-30 21:00:54.941654103 +0000 UTC m=+1265.800390397"
Oct 30 21:00:55.506704 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.506664    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"]
Oct 30 21:00:55.512542 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.512516    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.527432 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.527400    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"]
Oct 30 21:00:55.598079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.598012    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8kw2\" (UniqueName: \"kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-kube-api-access-p8kw2\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.598241 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.598121    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.598287 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.598250    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.598346 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.598298    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7de72904-4846-4ae7-baa4-07e587cb6199-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.598444 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.598427    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.598547 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.598532    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.598610 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.598595    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7de72904-4846-4ae7-baa4-07e587cb6199-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.598722 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.598698    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.598768 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.598746    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.613009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.612979    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"]
Oct 30 21:00:55.618471 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.618213    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.635307 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.635280    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"]
Oct 30 21:00:55.700315 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.700280    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdpcf\" (UniqueName: \"kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-kube-api-access-mdpcf\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.700315 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.700318    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.700539 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.700352    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.700605 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.700567    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.700759 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.700657    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7de72904-4846-4ae7-baa4-07e587cb6199-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.700759 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.700706    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.700870 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.700760    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.700870 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.700799    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.700944 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.700885    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.700944 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.700926    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.701102 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701078    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.701182 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701100    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.701235 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701213    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.701293 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701256    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8kw2\" (UniqueName: \"kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-kube-api-access-p8kw2\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.701293 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701267    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.701396 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701301    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.701396 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701360    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7de72904-4846-4ae7-baa4-07e587cb6199-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.701494 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701423    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.701556 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701499    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.701556 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701533    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7de72904-4846-4ae7-baa4-07e587cb6199-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.701654 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701566    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.701654 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701597    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.701753 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.701666    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.703815 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.703789    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.706741 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.706713    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7de72904-4846-4ae7-baa4-07e587cb6199-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.713222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.713199    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.713639 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.713620    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8kw2\" (UniqueName: \"kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-kube-api-access-p8kw2\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.802790 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.802696    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.802790 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.802745    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.802790 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.802782    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.803116 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.802821    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.803116 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.802862    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.803116 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.802949    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.803116 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.803053    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.803338 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.803150    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdpcf\" (UniqueName: \"kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-kube-api-access-mdpcf\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.803338 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.803185    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.803437 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.803337    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.803437 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.803371    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.803726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.803700    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.803726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.803713    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.803936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.803918    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.805191 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.805170    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.805452 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.805431    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.828125 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.828104    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdpcf\" (UniqueName: \"kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-kube-api-access-mdpcf\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.831823 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.831803    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.849982 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.849958    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:55.878822 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.878783    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:00:55.927594 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.926721    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"]
Oct 30 21:00:55.940183 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.939350    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:55.941626 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.941235    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:55.956220 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:55.956193    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"]
Oct 30 21:00:56.019382 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.010559    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.019382 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.010606    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.019382 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.010814    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.019382 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.010931    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.019382 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.010958    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrp4b\" (UniqueName: \"kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-kube-api-access-vrp4b\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.019382 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.010997    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.019382 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.011099    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.019382 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.011204    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.019382 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.011247    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.114550 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.114514    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.114742 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.114556    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrp4b\" (UniqueName: \"kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-kube-api-access-vrp4b\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.114742 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.114585    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.114742 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.114640    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.114742 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.114713    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.114960 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.114750    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.114960 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.114873    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.114960 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.114900    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.115135 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.114949    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-credential-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.115135 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.115058    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-data\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.115135 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.115100    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-socket\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.115135 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.115108    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.115317 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.115203    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-certs\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.115358 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.115334    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istiod-ca-cert\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.117047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.117006    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-envoy\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.117319 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.117302    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-podinfo\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.127268 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.127219    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrp4b\" (UniqueName: \"kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-kube-api-access-vrp4b\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.127797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.127776    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-token\") pod \"e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") " pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.169469 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.169421    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"]
Oct 30 21:00:56.169683 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:56.169656    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de72904_4846_4ae7_baa4_07e587cb6199.slice/crio-68d10d1195f1131dcb32138ca3e68fc10e9552a6844198a1f88c549925049510 WatchSource:0}: Error finding container 68d10d1195f1131dcb32138ca3e68fc10e9552a6844198a1f88c549925049510: Status 404 returned error can't find the container with id 68d10d1195f1131dcb32138ca3e68fc10e9552a6844198a1f88c549925049510
Oct 30 21:00:56.172564 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.172532    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:56.172657 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.172595    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:56.172657 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.172631    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:56.270795 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.270769    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:56.286095 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.286068    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"]
Oct 30 21:00:56.289877 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:00:56.289846    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce7325fd_eccd_4b9e_b1ef_770f781db58b.slice/crio-076fb64d71f13e0203b4df0c2b06687ae6c6d7572f72f7b58dbed439de6a5ffe WatchSource:0}: Error finding container 076fb64d71f13e0203b4df0c2b06687ae6c6d7572f72f7b58dbed439de6a5ffe: Status 404 returned error can't find the container with id 076fb64d71f13e0203b4df0c2b06687ae6c6d7572f72f7b58dbed439de6a5ffe
Oct 30 21:00:56.292808 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.292773    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:56.292907 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.292854    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:56.292907 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.292892    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:56.581849 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.581815    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"]
Oct 30 21:00:56.587219 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.587180    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:56.587346 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.587272    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:56.587346 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.587314    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:00:56.891545 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.891454    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms" event={"ID":"ce7325fd-eccd-4b9e-b1ef-770f781db58b","Type":"ContainerStarted","Data":"fea89a71f361db242892132b43439b17f8680f3e92913a8c7d533f3dd33e020c"}
Oct 30 21:00:56.891545 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.891513    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms" event={"ID":"ce7325fd-eccd-4b9e-b1ef-770f781db58b","Type":"ContainerStarted","Data":"076fb64d71f13e0203b4df0c2b06687ae6c6d7572f72f7b58dbed439de6a5ffe"}
Oct 30 21:00:56.893393 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.893364    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" event={"ID":"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a","Type":"ContainerStarted","Data":"df8e82eff8b7df8464b9e09ecb425d5daf5680988aeffc161ccddb140f41c9d0"}
Oct 30 21:00:56.893544 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.893408    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" event={"ID":"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a","Type":"ContainerStarted","Data":"32179af4f3255d4896c5307d8f06605719c39c6ca1b0428a0173e2fe695b63f6"}
Oct 30 21:00:56.899039 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.896575    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" event={"ID":"7de72904-4846-4ae7-baa4-07e587cb6199","Type":"ContainerStarted","Data":"53a01d98cb1e23c27c144ff0dc61efa59aa8756a6cbba8c926c37507294e5f4a"}
Oct 30 21:00:56.899039 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.896622    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" event={"ID":"7de72904-4846-4ae7-baa4-07e587cb6199","Type":"ContainerStarted","Data":"68d10d1195f1131dcb32138ca3e68fc10e9552a6844198a1f88c549925049510"}
Oct 30 21:00:56.925050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.924747    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms" podStartSLOduration=1.924726725 podStartE2EDuration="1.924726725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:56.922494159 +0000 UTC m=+1267.781230453" watchObservedRunningTime="2026-10-30 21:00:56.924726725 +0000 UTC m=+1267.783463019"
Oct 30 21:00:56.961047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:56.960893    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:00:57.011313 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:57.011161    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" podStartSLOduration=2.011142491 podStartE2EDuration="2.011142491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:56.958648698 +0000 UTC m=+1267.817384992" watchObservedRunningTime="2026-10-30 21:00:57.011142491 +0000 UTC m=+1267.869878791"
Oct 30 21:00:57.015805 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:57.015748    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" podStartSLOduration=2.015728794 podStartE2EDuration="2.015728794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:57.002509009 +0000 UTC m=+1267.861245302" watchObservedRunningTime="2026-10-30 21:00:57.015728794 +0000 UTC m=+1267.874465087"
Oct 30 21:00:57.278388 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:57.278300    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:57.279085 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:57.279047    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 21:00:57.349046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:57.344119    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:00:57.854050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:57.850419    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:00:57.867267 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:57.867213    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:57.867580 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:57.867529    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" podUID="7de72904-4846-4ae7-baa4-07e587cb6199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 21:00:57.954049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:57.953147    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:00:57.954049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:57.953213    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms" podUID="ce7325fd-eccd-4b9e-b1ef-770f781db58b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 21:00:58.274108 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:58.273572    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:58.274108 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:58.273639    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 21:00:58.861457 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:58.861418    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:58.862066 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:58.862016    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" podUID="7de72904-4846-4ae7-baa4-07e587cb6199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 21:00:58.950048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:58.947509    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:00:58.950048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:58.947575    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms" podUID="ce7325fd-eccd-4b9e-b1ef-770f781db58b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 21:00:59.303105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:59.302150    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:00:59.303105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:59.302231    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 21:00:59.862044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:59.861663    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:00:59.862044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:59.861732    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" podUID="7de72904-4846-4ae7-baa4-07e587cb6199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 21:00:59.941959 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:59.941920    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:00:59.942145 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:00:59.941984    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms" podUID="ce7325fd-eccd-4b9e-b1ef-770f781db58b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 21:01:00.274152 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:00.272510    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:01:00.274152 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:00.272572    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 21:01:00.924044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:00.878386    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:01:00.924044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:00.878448    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" podUID="7de72904-4846-4ae7-baa4-07e587cb6199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 21:01:00.968046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:00.967898    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:01:00.968046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:00.967969    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms" podUID="ce7325fd-eccd-4b9e-b1ef-770f781db58b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 21:01:01.282435 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:01.282344    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:01:01.282681 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:01.282643    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 21:01:01.880168 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:01.880128    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:01:01.880961 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:01.880918    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" podUID="7de72904-4846-4ae7-baa4-07e587cb6199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 21:01:01.960175 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:01.960137    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:01:02.018479 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:01.985453    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms" podUID="ce7325fd-eccd-4b9e-b1ef-770f781db58b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 21:01:02.273513 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:02.273415    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:01:02.277149 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:02.277101    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 21:01:02.854549 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:02.854512    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:01:02.854885 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:02.854851    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" podUID="7de72904-4846-4ae7-baa4-07e587cb6199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 30 21:01:02.941922 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:02.941877    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:01:02.942129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:02.941947    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms" podUID="ce7325fd-eccd-4b9e-b1ef-770f781db58b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Oct 30 21:01:03.272277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:03.271934    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Oct 30 21:01:03.272277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:03.272016    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Oct 30 21:01:03.859404 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:03.857602    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:01:03.859404 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:03.859234    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:01:03.860233 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:03.860187    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:01:04.275824 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:04.275742    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:01:04.276263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:04.276241    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:01:04.276941 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:04.276919    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:01:04.286146 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:04.286125    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:01:04.286402 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:04.286385    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:01:04.287254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:04.287236    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:01:10.537888 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.537838    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"]
Oct 30 21:01:10.544468 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.544437    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.562001 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.561968    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"]
Oct 30 21:01:10.598801 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.598763    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.599038 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.598838    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.599038 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.598944    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.599038 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.598984    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.599237 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.599121    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.599237 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.599180    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.599237 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.599223    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.599402 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.599369    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.599458 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.599401    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8cn8\" (UniqueName: \"kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-kube-api-access-c8cn8\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.641495 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.641461    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"]
Oct 30 21:01:10.645883 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.645852    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.668508 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.668474    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"]
Oct 30 21:01:10.700987 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.700950    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd9hm\" (UniqueName: \"kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-kube-api-access-vd9hm\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.701191 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701000    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.701191 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701130    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.701327 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701206    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.701327 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701286    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a13da80e-3191-468e-892f-db0a84b06b3c-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.701440 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701348    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a13da80e-3191-468e-892f-db0a84b06b3c-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.701440 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701423    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.701549 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701448    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.701549 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701460    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-data\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.701549 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701479    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.701712 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701547    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8cn8\" (UniqueName: \"kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-kube-api-access-c8cn8\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.701712 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701601    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.701712 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701654    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.701712 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701688    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.701914 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701738    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.701914 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701782    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.701914 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701817    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.701914 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701867    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.701914 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.701895    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.702323 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.702283    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-certs\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.702660 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.702636    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istiod-ca-cert\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.702974 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.702936    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.703224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.703203    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-credential-socket\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.704730 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.703936    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-envoy\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.705323 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.705300    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-podinfo\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.722391 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.722360    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8cn8\" (UniqueName: \"kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-kube-api-access-c8cn8\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.723742 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.723713    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-token\") pod \"e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") " pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.803246 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803159    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a13da80e-3191-468e-892f-db0a84b06b3c-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.803246 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803226    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.803246 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803243    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.803525 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803304    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.803525 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803322    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.803525 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803361    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.803525 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803391    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.803525 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803454    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd9hm\" (UniqueName: \"kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-kube-api-access-vd9hm\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.803788 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803580    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a13da80e-3191-468e-892f-db0a84b06b3c-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.803788 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803758    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.803891 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803795    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.803942 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803885    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.804012 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803944    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.804012 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.803980    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a13da80e-3191-468e-892f-db0a84b06b3c-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.805585 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.805567    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.806104 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.806089    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a13da80e-3191-468e-892f-db0a84b06b3c-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.830754 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.830725    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.830952 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.830931    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd9hm\" (UniqueName: \"kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-kube-api-access-vd9hm\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:10.866796 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.866768    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:10.968910 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:10.966592    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:11.127777 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.127745    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"]
Oct 30 21:01:11.133447 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.133416    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.145767 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.145736    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"]
Oct 30 21:01:11.159283 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.158257    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"]
Oct 30 21:01:11.159283 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:01:11.159167    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c15701_2c8e_4ec6_909b_e6cb642b42f4.slice/crio-47b5e1bd1e1b4c4a3c78293d25d071fbbdae4d942067417739b42cdcf0aa9c7f WatchSource:0}: Error finding container 47b5e1bd1e1b4c4a3c78293d25d071fbbdae4d942067417739b42cdcf0aa9c7f: Status 404 returned error can't find the container with id 47b5e1bd1e1b4c4a3c78293d25d071fbbdae4d942067417739b42cdcf0aa9c7f
Oct 30 21:01:11.162643 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.162612    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:11.162715 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.162686    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:11.162762 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.162746    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:11.198242 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.198213    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" event={"ID":"82c15701-2c8e-4ec6-909b-e6cb642b42f4","Type":"ContainerStarted","Data":"47b5e1bd1e1b4c4a3c78293d25d071fbbdae4d942067417739b42cdcf0aa9c7f"}
Oct 30 21:01:11.219569 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.219541    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24721fde-f300-468a-8621-e2e98ce6a888-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.219671 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.219583    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24721fde-f300-468a-8621-e2e98ce6a888-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.219671 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.219656    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.219788 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.219701    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.219899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.219877    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.220005 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.219987    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.220136 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.220119    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.220198 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.220187    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6tlf\" (UniqueName: \"kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-kube-api-access-l6tlf\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.220278 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.220262    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.298247 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.298216    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"]
Oct 30 21:01:11.299060 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:01:11.299004    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13da80e_3191_468e_892f_db0a84b06b3c.slice/crio-6fef65953a6c39f6f93364994116428b3c27ae75d9bf0f10eaca132bb7e59a18 WatchSource:0}: Error finding container 6fef65953a6c39f6f93364994116428b3c27ae75d9bf0f10eaca132bb7e59a18: Status 404 returned error can't find the container with id 6fef65953a6c39f6f93364994116428b3c27ae75d9bf0f10eaca132bb7e59a18
Oct 30 21:01:11.308902 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.308862    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:11.309002 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.308946    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:11.309002 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.308986    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:11.321878 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.321850    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.321981 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.321923    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.322076 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.321978    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tlf\" (UniqueName: \"kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-kube-api-access-l6tlf\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.322076 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.322064    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.322160 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.322122    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24721fde-f300-468a-8621-e2e98ce6a888-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.322207 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.322157    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24721fde-f300-468a-8621-e2e98ce6a888-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.322207 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.322197    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.322316 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.322293    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.322449 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.322430    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.322622 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.322583    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.322763 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.322744    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.323192 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.323169    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.323361 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.323334    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.323480 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.323421    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24721fde-f300-468a-8621-e2e98ce6a888-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.327934 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.327435    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24721fde-f300-468a-8621-e2e98ce6a888-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.327934 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.327616    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.335482 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.334510    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.335729 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.335712    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6tlf\" (UniqueName: \"kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-kube-api-access-l6tlf\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.468914 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.468661    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:11.893345 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.893299    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:11.893766 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.893397    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:11.893766 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.893441    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:11.903289 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:11.897721    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"]
Oct 30 21:01:12.305099 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.304307    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" event={"ID":"a13da80e-3191-468e-892f-db0a84b06b3c","Type":"ContainerStarted","Data":"911abf62d880413afacdd473541eb93d07bd7271aa29cebc498676b837e3bd1c"}
Oct 30 21:01:12.305099 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.304378    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" event={"ID":"a13da80e-3191-468e-892f-db0a84b06b3c","Type":"ContainerStarted","Data":"6fef65953a6c39f6f93364994116428b3c27ae75d9bf0f10eaca132bb7e59a18"}
Oct 30 21:01:12.322089 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.320136    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" event={"ID":"24721fde-f300-468a-8621-e2e98ce6a888","Type":"ContainerStarted","Data":"57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482"}
Oct 30 21:01:12.322089 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.320298    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" event={"ID":"24721fde-f300-468a-8621-e2e98ce6a888","Type":"ContainerStarted","Data":"477ca92c510b56e21af711d38b016c4658b9c04e682ebac3f685d5a96bebaa31"}
Oct 30 21:01:12.333058 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.333001    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" event={"ID":"82c15701-2c8e-4ec6-909b-e6cb642b42f4","Type":"ContainerStarted","Data":"344e3e1bd012486d27a13924bc94f464010ad54efc7edc8c595b3a4fbdbbb4e4"}
Oct 30 21:01:12.417075 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.413985    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" podStartSLOduration=2.413965304 podStartE2EDuration="2.413965304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:12.361520296 +0000 UTC m=+1283.220256595" watchObservedRunningTime="2026-10-30 21:01:12.413965304 +0000 UTC m=+1283.272701602"
Oct 30 21:01:12.491037 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.484145    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:12.509049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.507651    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" podStartSLOduration=2.5076251210000002 podStartE2EDuration="2.507625121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:12.416928032 +0000 UTC m=+1283.275664328" watchObservedRunningTime="2026-10-30 21:01:12.507625121 +0000 UTC m=+1283.366361426"
Oct 30 21:01:12.509049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.507859    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" podStartSLOduration=1.5078513390000001 podStartE2EDuration="1.507851339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:12.462414145 +0000 UTC m=+1283.321150439" watchObservedRunningTime="2026-10-30 21:01:12.507851339 +0000 UTC m=+1283.366587633"
Oct 30 21:01:12.886793 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.886757    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:12.887185 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.887159    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:01:12.887378 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.887349    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 21:01:12.972668 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.972088    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:13.015048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:12.997949    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:13.064049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:13.028161    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 21:01:13.497944 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:13.478799    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:13.497944 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:13.478863    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" podUID="24721fde-f300-468a-8621-e2e98ce6a888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 21:01:13.620171 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:13.620120    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:01:13.704046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:13.697719    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Oct 30 21:01:13.989048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:13.898448    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:01:13.989048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:13.898516    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 21:01:13.989048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:13.917349    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:14.005114 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:13.997745    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:14.005114 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:13.997808    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 21:01:14.536046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.532234    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:14.536046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.532294    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" podUID="24721fde-f300-468a-8621-e2e98ce6a888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 21:01:14.633048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.612113    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded"
Oct 30 21:01:14.633048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.614745    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Oct 30 21:01:14.633048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.630295    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:14.633048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.630853    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:01:14.650577 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.650086    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:14.675050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.656247    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podUID="18730625-e6ba-421a-9a27-02acc29e9a2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.31:8000/ready\": context deadline exceeded"
Oct 30 21:01:14.721356 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.704407    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Oct 30 21:01:14.721356 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.705038    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 21:01:14.770925 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.731121    6048 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:14.887047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.886896    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:01:14.887047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.886979    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 21:01:14.937260 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.926717    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:14.937260 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:14.927111    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:01:15.077422 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.077386    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:15.087149 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.087099    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 21:01:15.536704 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.536662    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": context deadline exceeded"
Oct 30 21:01:15.657586 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.657541    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:15.658795 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.658762    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded"
Oct 30 21:01:15.659656 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.659626    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podUID="18730625-e6ba-421a-9a27-02acc29e9a2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.31:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:15.660253 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.660227    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Oct 30 21:01:15.661050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.661006    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:15.661248 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.661226    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" podUID="24721fde-f300-468a-8621-e2e98ce6a888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 21:01:15.675186 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.675143    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:01:15.703216 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.703171    6048 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:15.704953 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.704914    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:15.877047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.872917    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:01:15.895046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:15.892121    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 21:01:16.067058 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.047260    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:16.372059 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:01:16.366342    6048 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.049s"
Oct 30 21:01:16.372059 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.366462    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:01:16.372059 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.366557    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 21:01:16.372059 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.366639    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 21:01:16.372059 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.366705    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 21:01:16.372059 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.366762    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 21:01:16.372059 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.366810    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 21:01:16.372059 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.366853    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 21:01:16.453142 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.451560    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:01:16.542280 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.542209    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:16.626547 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.626457    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:16.626777 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.626750    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 21:01:16.628487 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.628458    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:01:16.630717 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.630688    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:16.630822 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.630736    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" podUID="24721fde-f300-468a-8621-e2e98ce6a888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 21:01:16.639072 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.634519    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 21:01:16.640054 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.639775    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 21:01:16.645105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.640442    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:01:16.890710 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.890607    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:01:16.890967 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.890940    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 21:01:16.941907 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.941792    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 21:01:17.009308 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:01:16.997665    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:01:17.009308 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.998492    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:17.009308 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:16.998553    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 21:01:17.489050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:17.479472    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:17.489050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:17.479548    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" podUID="24721fde-f300-468a-8621-e2e98ce6a888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 21:01:17.932463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:17.932413    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:01:17.932722 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:17.932696    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 21:01:17.983050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:17.978655    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:17.983050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:17.978721    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 21:01:18.484043 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:18.478403    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:18.484043 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:18.478464    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" podUID="24721fde-f300-468a-8621-e2e98ce6a888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 21:01:18.872064 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:18.870125    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:01:18.872064 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:18.870196    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 21:01:18.980045 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:18.969289    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:18.980045 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:18.969351    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 21:01:19.473047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:19.470457    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:19.473047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:19.470520    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" podUID="24721fde-f300-468a-8621-e2e98ce6a888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 21:01:19.892078 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:19.887170    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:01:19.892078 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:19.887232    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Oct 30 21:01:19.975527 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:19.975487    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:01:19.975840 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:19.975783    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Oct 30 21:01:20.470183 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:20.470142    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:01:20.470475 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:20.470438    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" podUID="24721fde-f300-468a-8621-e2e98ce6a888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Oct 30 21:01:20.972388 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:20.972354    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:20.972953 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:20.972753    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:20.973633 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:20.973610    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:01:21.517910 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:21.517878    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:21.518981 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:21.518953    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:21.520995 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:21.520977    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:01:21.914200 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:21.914159    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:21.914412 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:21.914254    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:22.006300 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:22.006268    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:22.006755 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:22.006739    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:22.007532 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:22.007512    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:01:25.706836 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.706805    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"]
Oct 30 21:01:25.716342 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.716312    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:25.721059 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.720992    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:01:25.721333 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.721309    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"]
Oct 30 21:01:25.723258 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.723232    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:01:25.790723 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.790688    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-597267e1-7k5nx\" (UID: \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:25.790952 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.790933    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-597267e1-7k5nx\" (UID: \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:25.791157 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.791141    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbc5b\" (UniqueName: \"kubernetes.io/projected/9c22af4d-e9fa-4c42-afa9-691b151e46e2-kube-api-access-zbc5b\") pod \"maas-api-revoke-sub-597267e1-7k5nx\" (UID: \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:25.892182 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.892140    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-597267e1-7k5nx\" (UID: \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:25.892373 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.892354    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbc5b\" (UniqueName: \"kubernetes.io/projected/9c22af4d-e9fa-4c42-afa9-691b151e46e2-kube-api-access-zbc5b\") pod \"maas-api-revoke-sub-597267e1-7k5nx\" (UID: \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:25.892436 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.892395    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-597267e1-7k5nx\" (UID: \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:25.893081 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.893059    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-597267e1-7k5nx\" (UID: \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:25.894624 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.894603    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-597267e1-7k5nx\" (UID: \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:25.939913 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:25.939881    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbc5b\" (UniqueName: \"kubernetes.io/projected/9c22af4d-e9fa-4c42-afa9-691b151e46e2-kube-api-access-zbc5b\") pod \"maas-api-revoke-sub-597267e1-7k5nx\" (UID: \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:26.050529 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:26.050310    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:26.343411 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:26.343381    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"]
Oct 30 21:01:26.343689 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:01:26.343667    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c22af4d_e9fa_4c42_afa9_691b151e46e2.slice/crio-20300f6ebccdf958ac3cc515e3a3f73841e0d30f78a0e56dd89e1e121e08f953 WatchSource:0}: Error finding container 20300f6ebccdf958ac3cc515e3a3f73841e0d30f78a0e56dd89e1e121e08f953: Status 404 returned error can't find the container with id 20300f6ebccdf958ac3cc515e3a3f73841e0d30f78a0e56dd89e1e121e08f953
Oct 30 21:01:26.826880 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:26.826841    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx" event={"ID":"9c22af4d-e9fa-4c42-afa9-691b151e46e2","Type":"ContainerStarted","Data":"48a0e69f87ad4ea5594f61eb550052924715facc5b37c95efb9948ae42fd2c95"}
Oct 30 21:01:26.827367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:26.826898    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx" event={"ID":"9c22af4d-e9fa-4c42-afa9-691b151e46e2","Type":"ContainerStarted","Data":"20300f6ebccdf958ac3cc515e3a3f73841e0d30f78a0e56dd89e1e121e08f953"}
Oct 30 21:01:26.852346 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:26.852283    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx" podStartSLOduration=1.852269398 podStartE2EDuration="1.852269398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:26.850361788 +0000 UTC m=+1297.709098092" watchObservedRunningTime="2026-10-30 21:01:26.852269398 +0000 UTC m=+1297.711005691"
Oct 30 21:01:27.835228 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:27.835194    6048 generic.go:356] "Generic (PLEG): container finished" podID="9c22af4d-e9fa-4c42-afa9-691b151e46e2" containerID="48a0e69f87ad4ea5594f61eb550052924715facc5b37c95efb9948ae42fd2c95" exitCode=0
Oct 30 21:01:27.835655 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:27.835281    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx" event={"ID":"9c22af4d-e9fa-4c42-afa9-691b151e46e2","Type":"ContainerDied","Data":"48a0e69f87ad4ea5594f61eb550052924715facc5b37c95efb9948ae42fd2c95"}
Oct 30 21:01:28.999589 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:28.999567    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:29.148475 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:29.148389    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c22af4d-e9fa-4c42-afa9-691b151e46e2-kube-api-access-zbc5b\" (UniqueName: \"kubernetes.io/projected/9c22af4d-e9fa-4c42-afa9-691b151e46e2-kube-api-access-zbc5b\") pod \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\" (UID: \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\") "
Oct 30 21:01:29.148475 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:29.148448    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-xks-ca\") pod \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\" (UID: \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\") "
Oct 30 21:01:29.148475 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:29.148473    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-openshift-ca\") pod \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\" (UID: \"9c22af4d-e9fa-4c42-afa9-691b151e46e2\") "
Oct 30 21:01:29.148916 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:29.148890    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-openshift-ca" pod "9c22af4d-e9fa-4c42-afa9-691b151e46e2" (UID: "9c22af4d-e9fa-4c42-afa9-691b151e46e2"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:29.149155 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:29.149136    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:29.150584 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:29.150557    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-xks-ca" pod "9c22af4d-e9fa-4c42-afa9-691b151e46e2" (UID: "9c22af4d-e9fa-4c42-afa9-691b151e46e2"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:29.150705 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:29.150583    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c22af4d-e9fa-4c42-afa9-691b151e46e2-kube-api-access-zbc5b" pod "9c22af4d-e9fa-4c42-afa9-691b151e46e2" (UID: "9c22af4d-e9fa-4c42-afa9-691b151e46e2"). InnerVolumeSpecName "kube-api-access-zbc5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:29.250199 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:29.250163    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbc5b\" (UniqueName: \"kubernetes.io/projected/9c22af4d-e9fa-4c42-afa9-691b151e46e2-kube-api-access-zbc5b\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:29.250199 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:29.250194    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9c22af4d-e9fa-4c42-afa9-691b151e46e2-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:29.856586 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:29.856554    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"
Oct 30 21:01:29.856770 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:29.856550    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx" event={"ID":"9c22af4d-e9fa-4c42-afa9-691b151e46e2","Type":"ContainerDied","Data":"20300f6ebccdf958ac3cc515e3a3f73841e0d30f78a0e56dd89e1e121e08f953"}
Oct 30 21:01:29.856770 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:29.856687    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20300f6ebccdf958ac3cc515e3a3f73841e0d30f78a0e56dd89e1e121e08f953"
Oct 30 21:01:32.963924 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:32.963877    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:33.064054 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:33.063314    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:33.068044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:33.065662    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:33.068044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:33.067527    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:33.473224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:33.473167    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:33.608047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:33.607449    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:33.641369 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:33.641311    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podUID="18730625-e6ba-421a-9a27-02acc29e9a2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.31:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:34.005056 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:33.988726    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:34.063047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.047613    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 21:01:34.133577 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.077101    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Oct 30 21:01:34.134689 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.077795    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:01:34.149055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.138177    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 21:01:34.152622 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.152595    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:01:34.320050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.314478    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:34.320050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.314538    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:34.494059 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.493483    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:34.507048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.495376    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:01:34.630107 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.615640    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:34.630107 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.616376    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 21:01:34.680577 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.657208    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podUID="18730625-e6ba-421a-9a27-02acc29e9a2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.31:8000/ready\": context deadline exceeded"
Oct 30 21:01:34.726349 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.681274    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 21:01:34.726349 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.711674    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:01:34.785053 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.784418    6048 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:34.922146 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.901687    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:34.922146 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.901788    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:34.923663 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.923438    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:34.923663 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:34.923500    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" podUID="7de72904-4846-4ae7-baa4-07e587cb6199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.058050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.050174    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.166225 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.139142    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.166225 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.139593    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Oct 30 21:01:35.166225 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.155179    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.257638 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.257534    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:35.257909 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.257857    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.313049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.305072    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:35.313049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.305141    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.366044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.365499    6048 patch_prober.go:29] interesting pod/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:35.366044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.365562    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.488050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.487461    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 21:01:35.544576 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.529599    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.618190 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.616043    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.743047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.714316    6048 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/health\": context deadline exceeded"
Oct 30 21:01:35.743047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.714399    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:01:35.743047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.734224    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:01:35.755419 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.755259    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:01:35.755419 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.755318    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" podUID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:35.768096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.767155    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:01:35.896658 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.896627    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:01:35.988577 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:35.988543    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 21:01:36.055047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:36.051773    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": context deadline exceeded"
Oct 30 21:01:36.055633 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:36.055607    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 21:01:36.121511 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:36.119990    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:01:36.138796 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:36.137609    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 21:01:38.863716 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:38.863684    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"]
Oct 30 21:01:38.864426 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:38.864407    6048 cpu_manager.go:414] "containerMap: removing container" podUID="9c22af4d-e9fa-4c42-afa9-691b151e46e2" containerName="revoke-keys"
Oct 30 21:01:38.864500 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:38.864429    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c22af4d-e9fa-4c42-afa9-691b151e46e2" containerName="revoke-keys"
Oct 30 21:01:38.864586 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:38.864576    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="9c22af4d-e9fa-4c42-afa9-691b151e46e2" containerName="revoke-keys"
Oct 30 21:01:38.868309 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:38.868289    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:38.874674 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:38.874651    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:01:38.874843 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:38.874668    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:01:38.879792 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:38.879761    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"]
Oct 30 21:01:38.902882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:38.902842    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9bd739b5-wr988\" (UID: \"4dc39679-a506-44f3-a5d3-36630be0d753\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:38.903196 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:38.903166    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9bd739b5-wr988\" (UID: \"4dc39679-a506-44f3-a5d3-36630be0d753\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:38.903356 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:38.903269    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkwlc\" (UniqueName: \"kubernetes.io/projected/4dc39679-a506-44f3-a5d3-36630be0d753-kube-api-access-zkwlc\") pod \"maas-api-revoke-sub-9bd739b5-wr988\" (UID: \"4dc39679-a506-44f3-a5d3-36630be0d753\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:39.004819 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:39.004784    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9bd739b5-wr988\" (UID: \"4dc39679-a506-44f3-a5d3-36630be0d753\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:39.004819 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:39.004830    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkwlc\" (UniqueName: \"kubernetes.io/projected/4dc39679-a506-44f3-a5d3-36630be0d753-kube-api-access-zkwlc\") pod \"maas-api-revoke-sub-9bd739b5-wr988\" (UID: \"4dc39679-a506-44f3-a5d3-36630be0d753\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:39.005100 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:39.004886    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9bd739b5-wr988\" (UID: \"4dc39679-a506-44f3-a5d3-36630be0d753\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:39.005496 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:39.005472    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9bd739b5-wr988\" (UID: \"4dc39679-a506-44f3-a5d3-36630be0d753\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:39.007273 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:39.007253    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9bd739b5-wr988\" (UID: \"4dc39679-a506-44f3-a5d3-36630be0d753\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:39.017235 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:39.017214    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkwlc\" (UniqueName: \"kubernetes.io/projected/4dc39679-a506-44f3-a5d3-36630be0d753-kube-api-access-zkwlc\") pod \"maas-api-revoke-sub-9bd739b5-wr988\" (UID: \"4dc39679-a506-44f3-a5d3-36630be0d753\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:39.202677 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:39.202605    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:39.487092 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:01:39.487056    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc39679_a506_44f3_a5d3_36630be0d753.slice/crio-3715c772f5887c7f34e81bac3e0ef0afaa48988de651671acd7d46673d19a6a2 WatchSource:0}: Error finding container 3715c772f5887c7f34e81bac3e0ef0afaa48988de651671acd7d46673d19a6a2: Status 404 returned error can't find the container with id 3715c772f5887c7f34e81bac3e0ef0afaa48988de651671acd7d46673d19a6a2
Oct 30 21:01:39.487602 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:39.487574    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"]
Oct 30 21:01:40.173607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:40.173502    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988" event={"ID":"4dc39679-a506-44f3-a5d3-36630be0d753","Type":"ContainerStarted","Data":"b617be7dca36b85c61a533ddde2af4ae18f08049abfed5f35e2f54d4c7877bb7"}
Oct 30 21:01:40.173607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:40.173565    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988" event={"ID":"4dc39679-a506-44f3-a5d3-36630be0d753","Type":"ContainerStarted","Data":"3715c772f5887c7f34e81bac3e0ef0afaa48988de651671acd7d46673d19a6a2"}
Oct 30 21:01:40.194525 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:40.194470    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988" podStartSLOduration=2.194456353 podStartE2EDuration="2.194456353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:40.192565107 +0000 UTC m=+1311.051301400" watchObservedRunningTime="2026-10-30 21:01:40.194456353 +0000 UTC m=+1311.053192646"
Oct 30 21:01:41.182148 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:41.182113    6048 generic.go:356] "Generic (PLEG): container finished" podID="4dc39679-a506-44f3-a5d3-36630be0d753" containerID="b617be7dca36b85c61a533ddde2af4ae18f08049abfed5f35e2f54d4c7877bb7" exitCode=0
Oct 30 21:01:41.182550 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:41.182194    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988" event={"ID":"4dc39679-a506-44f3-a5d3-36630be0d753","Type":"ContainerDied","Data":"b617be7dca36b85c61a533ddde2af4ae18f08049abfed5f35e2f54d4c7877bb7"}
Oct 30 21:01:42.386388 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:42.386352    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:42.465292 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:42.465206    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-xks-ca\") pod \"4dc39679-a506-44f3-a5d3-36630be0d753\" (UID: \"4dc39679-a506-44f3-a5d3-36630be0d753\") "
Oct 30 21:01:42.465292 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:42.465267    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-openshift-ca\") pod \"4dc39679-a506-44f3-a5d3-36630be0d753\" (UID: \"4dc39679-a506-44f3-a5d3-36630be0d753\") "
Oct 30 21:01:42.465507 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:42.465490    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4dc39679-a506-44f3-a5d3-36630be0d753-kube-api-access-zkwlc\" (UniqueName: \"kubernetes.io/projected/4dc39679-a506-44f3-a5d3-36630be0d753-kube-api-access-zkwlc\") pod \"4dc39679-a506-44f3-a5d3-36630be0d753\" (UID: \"4dc39679-a506-44f3-a5d3-36630be0d753\") "
Oct 30 21:01:42.465633 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:42.465610    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-openshift-ca" pod "4dc39679-a506-44f3-a5d3-36630be0d753" (UID: "4dc39679-a506-44f3-a5d3-36630be0d753"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:42.465982 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:42.465961    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:42.467443 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:42.467420    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-xks-ca" pod "4dc39679-a506-44f3-a5d3-36630be0d753" (UID: "4dc39679-a506-44f3-a5d3-36630be0d753"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:42.467547 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:42.467499    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dc39679-a506-44f3-a5d3-36630be0d753-kube-api-access-zkwlc" pod "4dc39679-a506-44f3-a5d3-36630be0d753" (UID: "4dc39679-a506-44f3-a5d3-36630be0d753"). InnerVolumeSpecName "kube-api-access-zkwlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:42.567615 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:42.567585    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4dc39679-a506-44f3-a5d3-36630be0d753-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:42.567615 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:42.567612    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkwlc\" (UniqueName: \"kubernetes.io/projected/4dc39679-a506-44f3-a5d3-36630be0d753-kube-api-access-zkwlc\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:43.093317 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.093285    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"]
Oct 30 21:01:43.094137 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.094114    6048 cpu_manager.go:414] "containerMap: removing container" podUID="4dc39679-a506-44f3-a5d3-36630be0d753" containerName="revoke-keys"
Oct 30 21:01:43.094137 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.094135    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4dc39679-a506-44f3-a5d3-36630be0d753" containerName="revoke-keys"
Oct 30 21:01:43.094331 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.094318    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="4dc39679-a506-44f3-a5d3-36630be0d753" containerName="revoke-keys"
Oct 30 21:01:43.098170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.098149    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:43.107234 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.106910    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"]
Oct 30 21:01:43.174852 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.174816    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx\" (UID: \"2af62151-d35d-4b7c-ad00-46e563b277ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:43.175142 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.175118    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx\" (UID: \"2af62151-d35d-4b7c-ad00-46e563b277ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:43.175248 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.175227    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxfx7\" (UniqueName: \"kubernetes.io/projected/2af62151-d35d-4b7c-ad00-46e563b277ef-kube-api-access-lxfx7\") pod \"maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx\" (UID: \"2af62151-d35d-4b7c-ad00-46e563b277ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:43.197099 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.197067    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"
Oct 30 21:01:43.197261 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.197063    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988" event={"ID":"4dc39679-a506-44f3-a5d3-36630be0d753","Type":"ContainerDied","Data":"3715c772f5887c7f34e81bac3e0ef0afaa48988de651671acd7d46673d19a6a2"}
Oct 30 21:01:43.197261 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.197208    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3715c772f5887c7f34e81bac3e0ef0afaa48988de651671acd7d46673d19a6a2"
Oct 30 21:01:43.276267 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.276234    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx\" (UID: \"2af62151-d35d-4b7c-ad00-46e563b277ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:43.276449 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.276385    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx\" (UID: \"2af62151-d35d-4b7c-ad00-46e563b277ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:43.276449 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.276427    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxfx7\" (UniqueName: \"kubernetes.io/projected/2af62151-d35d-4b7c-ad00-46e563b277ef-kube-api-access-lxfx7\") pod \"maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx\" (UID: \"2af62151-d35d-4b7c-ad00-46e563b277ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:43.276842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.276821    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx\" (UID: \"2af62151-d35d-4b7c-ad00-46e563b277ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:43.278732 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.278709    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx\" (UID: \"2af62151-d35d-4b7c-ad00-46e563b277ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:43.288486 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.288462    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxfx7\" (UniqueName: \"kubernetes.io/projected/2af62151-d35d-4b7c-ad00-46e563b277ef-kube-api-access-lxfx7\") pod \"maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx\" (UID: \"2af62151-d35d-4b7c-ad00-46e563b277ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:43.415173 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.415088    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:43.696620 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:01:43.696578    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af62151_d35d_4b7c_ad00_46e563b277ef.slice/crio-02e07b91a966b27cb678a4591ae262226616b31349a511bd91cc4c9821959a11 WatchSource:0}: Error finding container 02e07b91a966b27cb678a4591ae262226616b31349a511bd91cc4c9821959a11: Status 404 returned error can't find the container with id 02e07b91a966b27cb678a4591ae262226616b31349a511bd91cc4c9821959a11
Oct 30 21:01:43.696620 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:43.696599    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"]
Oct 30 21:01:44.210352 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:44.210252    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx" event={"ID":"2af62151-d35d-4b7c-ad00-46e563b277ef","Type":"ContainerStarted","Data":"4eb80fe1cf166870c5cee1017ef5b091abef5ed0f1f151c88c2f7818cbebd092"}
Oct 30 21:01:44.210526 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:44.210357    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx" event={"ID":"2af62151-d35d-4b7c-ad00-46e563b277ef","Type":"ContainerStarted","Data":"02e07b91a966b27cb678a4591ae262226616b31349a511bd91cc4c9821959a11"}
Oct 30 21:01:44.232624 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:44.232568    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx" podStartSLOduration=1.232555991 podStartE2EDuration="1.232555991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:44.229224316 +0000 UTC m=+1315.087960610" watchObservedRunningTime="2026-10-30 21:01:44.232555991 +0000 UTC m=+1315.091292306"
Oct 30 21:01:45.223948 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:45.223909    6048 generic.go:356] "Generic (PLEG): container finished" podID="2af62151-d35d-4b7c-ad00-46e563b277ef" containerID="4eb80fe1cf166870c5cee1017ef5b091abef5ed0f1f151c88c2f7818cbebd092" exitCode=0
Oct 30 21:01:45.224387 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:45.224008    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx" event={"ID":"2af62151-d35d-4b7c-ad00-46e563b277ef","Type":"ContainerDied","Data":"4eb80fe1cf166870c5cee1017ef5b091abef5ed0f1f151c88c2f7818cbebd092"}
Oct 30 21:01:46.385166 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:46.385140    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:46.532497 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:46.532415    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2af62151-d35d-4b7c-ad00-46e563b277ef-kube-api-access-lxfx7\" (UniqueName: \"kubernetes.io/projected/2af62151-d35d-4b7c-ad00-46e563b277ef-kube-api-access-lxfx7\") pod \"2af62151-d35d-4b7c-ad00-46e563b277ef\" (UID: \"2af62151-d35d-4b7c-ad00-46e563b277ef\") "
Oct 30 21:01:46.532647 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:46.532537    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-xks-ca\") pod \"2af62151-d35d-4b7c-ad00-46e563b277ef\" (UID: \"2af62151-d35d-4b7c-ad00-46e563b277ef\") "
Oct 30 21:01:46.532842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:46.532818    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-openshift-ca\") pod \"2af62151-d35d-4b7c-ad00-46e563b277ef\" (UID: \"2af62151-d35d-4b7c-ad00-46e563b277ef\") "
Oct 30 21:01:46.533217 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:46.533189    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-openshift-ca" pod "2af62151-d35d-4b7c-ad00-46e563b277ef" (UID: "2af62151-d35d-4b7c-ad00-46e563b277ef"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:46.533422 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:46.533404    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:46.534586 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:46.534561    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2af62151-d35d-4b7c-ad00-46e563b277ef-kube-api-access-lxfx7" pod "2af62151-d35d-4b7c-ad00-46e563b277ef" (UID: "2af62151-d35d-4b7c-ad00-46e563b277ef"). InnerVolumeSpecName "kube-api-access-lxfx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:46.534710 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:46.534696    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-xks-ca" pod "2af62151-d35d-4b7c-ad00-46e563b277ef" (UID: "2af62151-d35d-4b7c-ad00-46e563b277ef"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:46.634562 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:46.634528    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxfx7\" (UniqueName: \"kubernetes.io/projected/2af62151-d35d-4b7c-ad00-46e563b277ef-kube-api-access-lxfx7\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:46.634562 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:46.634559    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2af62151-d35d-4b7c-ad00-46e563b277ef-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:46.802804 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:01:46.802711    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:01:47.240753 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:47.240724    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"
Oct 30 21:01:47.240930 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:47.240755    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx" event={"ID":"2af62151-d35d-4b7c-ad00-46e563b277ef","Type":"ContainerDied","Data":"02e07b91a966b27cb678a4591ae262226616b31349a511bd91cc4c9821959a11"}
Oct 30 21:01:47.240930 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:47.240806    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02e07b91a966b27cb678a4591ae262226616b31349a511bd91cc4c9821959a11"
Oct 30 21:01:53.239143 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:53.239109    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"]
Oct 30 21:01:55.103666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.103630    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"]
Oct 30 21:01:55.104496 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.104473    6048 cpu_manager.go:414] "containerMap: removing container" podUID="2af62151-d35d-4b7c-ad00-46e563b277ef" containerName="revoke-keys"
Oct 30 21:01:55.104602 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.104497    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2af62151-d35d-4b7c-ad00-46e563b277ef" containerName="revoke-keys"
Oct 30 21:01:55.104692 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.104677    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="2af62151-d35d-4b7c-ad00-46e563b277ef" containerName="revoke-keys"
Oct 30 21:01:55.109640 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.109620    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:55.114587 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.114059    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:01:55.114587 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.114325    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:01:55.117981 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.117958    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"]
Oct 30 21:01:55.159207 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.159174    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcgff\" (UniqueName: \"kubernetes.io/projected/229b2909-25f1-46df-ac6d-61837eaf3b85-kube-api-access-xcgff\") pod \"maas-api-revoke-sub-f45d5f1c-sp25b\" (UID: \"229b2909-25f1-46df-ac6d-61837eaf3b85\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:55.159401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.159278    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f45d5f1c-sp25b\" (UID: \"229b2909-25f1-46df-ac6d-61837eaf3b85\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:55.159401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.159349    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f45d5f1c-sp25b\" (UID: \"229b2909-25f1-46df-ac6d-61837eaf3b85\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:55.260295 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.260261    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcgff\" (UniqueName: \"kubernetes.io/projected/229b2909-25f1-46df-ac6d-61837eaf3b85-kube-api-access-xcgff\") pod \"maas-api-revoke-sub-f45d5f1c-sp25b\" (UID: \"229b2909-25f1-46df-ac6d-61837eaf3b85\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:55.260503 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.260364    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f45d5f1c-sp25b\" (UID: \"229b2909-25f1-46df-ac6d-61837eaf3b85\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:55.260503 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.260444    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f45d5f1c-sp25b\" (UID: \"229b2909-25f1-46df-ac6d-61837eaf3b85\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:55.261146 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.261126    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f45d5f1c-sp25b\" (UID: \"229b2909-25f1-46df-ac6d-61837eaf3b85\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:55.262914 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.262891    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f45d5f1c-sp25b\" (UID: \"229b2909-25f1-46df-ac6d-61837eaf3b85\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:55.272368 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.272348    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcgff\" (UniqueName: \"kubernetes.io/projected/229b2909-25f1-46df-ac6d-61837eaf3b85-kube-api-access-xcgff\") pod \"maas-api-revoke-sub-f45d5f1c-sp25b\" (UID: \"229b2909-25f1-46df-ac6d-61837eaf3b85\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:55.428142 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.428066    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:55.707914 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.707840    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"]
Oct 30 21:01:55.713500 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.713477    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.727151 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:01:55.727123    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod229b2909_25f1_46df_ac6d_61837eaf3b85.slice/crio-98ad4db0cc5e56b6bc54c95c0c4e0aada2a0bd1ce489391ba2bb109eb38f3a15 WatchSource:0}: Error finding container 98ad4db0cc5e56b6bc54c95c0c4e0aada2a0bd1ce489391ba2bb109eb38f3a15: Status 404 returned error can't find the container with id 98ad4db0cc5e56b6bc54c95c0c4e0aada2a0bd1ce489391ba2bb109eb38f3a15
Oct 30 21:01:55.728532 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.728510    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"]
Oct 30 21:01:55.733064 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.732997    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"]
Oct 30 21:01:55.772043 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.771983    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.772254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.772229    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.772462 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.772439    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.772566 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.772547    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.772657 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.772593    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnkw2\" (UniqueName: \"kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-kube-api-access-qnkw2\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.772695 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.772667    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.772833 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.772806    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ba0657-f0de-4706-8917-56d3c9d53cad-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.772877 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.772853    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.772939 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.772905    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.874115 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874074    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ba0657-f0de-4706-8917-56d3c9d53cad-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.874115 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874113    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.874351 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874228    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.874351 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874269    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.874460 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874394    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.874460 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874422    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.874564 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874546    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.874619 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874585    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-certs\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.874619 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874597    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.874736 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874627    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnkw2\" (UniqueName: \"kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-kube-api-access-qnkw2\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.874736 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874653    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.874927 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874896    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ba0657-f0de-4706-8917-56d3c9d53cad-istiod-ca-cert\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.875002 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874952    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-credential-socket\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.875002 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.874985    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-data\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.876600 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.876577    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-envoy\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.876820 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.876801    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-podinfo\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.894014 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.893992    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnkw2\" (UniqueName: \"kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-kube-api-access-qnkw2\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:55.904057 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:55.904018    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-token\") pod \"e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") " pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:56.034264 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:56.034233    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:56.309738 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:56.309703    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b" event={"ID":"229b2909-25f1-46df-ac6d-61837eaf3b85","Type":"ContainerStarted","Data":"04db3954a130beae9a06a4ec41ea4900db53cc32e6420773f64c230e7f03abe7"}
Oct 30 21:01:56.310240 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:56.309781    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b" event={"ID":"229b2909-25f1-46df-ac6d-61837eaf3b85","Type":"ContainerStarted","Data":"98ad4db0cc5e56b6bc54c95c0c4e0aada2a0bd1ce489391ba2bb109eb38f3a15"}
Oct 30 21:01:56.333125 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:56.333089    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"]
Oct 30 21:01:56.334083 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:01:56.334057    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ba0657_f0de_4706_8917_56d3c9d53cad.slice/crio-b7f2d697b256fd15653a4af86a6468d971e473e51482a1c122da260022efef63 WatchSource:0}: Error finding container b7f2d697b256fd15653a4af86a6468d971e473e51482a1c122da260022efef63: Status 404 returned error can't find the container with id b7f2d697b256fd15653a4af86a6468d971e473e51482a1c122da260022efef63
Oct 30 21:01:56.336486 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:56.336433    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b" podStartSLOduration=1.336416161 podStartE2EDuration="1.336416161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:56.335599346 +0000 UTC m=+1327.194335636" watchObservedRunningTime="2026-10-30 21:01:56.336416161 +0000 UTC m=+1327.195152455"
Oct 30 21:01:56.338054 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:56.337993    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:56.338143 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:56.338068    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:56.338143 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:56.338099    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:01:57.319384 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:57.319350    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" event={"ID":"e7ba0657-f0de-4706-8917-56d3c9d53cad","Type":"ContainerStarted","Data":"7d8c02f265137243e3449a5bb330d7e4e5acc2ad2febdb8854370a3fb7c380d2"}
Oct 30 21:01:57.319852 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:57.319409    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" event={"ID":"e7ba0657-f0de-4706-8917-56d3c9d53cad","Type":"ContainerStarted","Data":"b7f2d697b256fd15653a4af86a6468d971e473e51482a1c122da260022efef63"}
Oct 30 21:01:57.321164 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:57.321140    6048 generic.go:356] "Generic (PLEG): container finished" podID="229b2909-25f1-46df-ac6d-61837eaf3b85" containerID="04db3954a130beae9a06a4ec41ea4900db53cc32e6420773f64c230e7f03abe7" exitCode=0
Oct 30 21:01:57.321267 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:57.321241    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b" event={"ID":"229b2909-25f1-46df-ac6d-61837eaf3b85","Type":"ContainerDied","Data":"04db3954a130beae9a06a4ec41ea4900db53cc32e6420773f64c230e7f03abe7"}
Oct 30 21:01:57.364047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:57.362946    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podStartSLOduration=2.36292525 podStartE2EDuration="2.36292525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:57.354214122 +0000 UTC m=+1328.212950417" watchObservedRunningTime="2026-10-30 21:01:57.36292525 +0000 UTC m=+1328.221661544"
Oct 30 21:01:58.035090 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:58.034695    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:01:58.036004 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:58.035964    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:01:58.036192 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:58.036063    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 21:01:58.243146 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:58.243097    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx" podUID="eb2b1bb4-d4c9-408d-ac24-6510b420b4dd" containerName="payload-processing" containerID="cri-o://c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0" gracePeriod=25
Oct 30 21:01:59.079739 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.079692    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:01:59.080225 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.079761    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 21:01:59.400366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.400260    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:59.593885 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.578475    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-openshift-ca\") pod \"229b2909-25f1-46df-ac6d-61837eaf3b85\" (UID: \"229b2909-25f1-46df-ac6d-61837eaf3b85\") "
Oct 30 21:01:59.593885 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.578579    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/229b2909-25f1-46df-ac6d-61837eaf3b85-kube-api-access-xcgff\" (UniqueName: \"kubernetes.io/projected/229b2909-25f1-46df-ac6d-61837eaf3b85-kube-api-access-xcgff\") pod \"229b2909-25f1-46df-ac6d-61837eaf3b85\" (UID: \"229b2909-25f1-46df-ac6d-61837eaf3b85\") "
Oct 30 21:01:59.593885 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.578723    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-xks-ca\") pod \"229b2909-25f1-46df-ac6d-61837eaf3b85\" (UID: \"229b2909-25f1-46df-ac6d-61837eaf3b85\") "
Oct 30 21:01:59.606610 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.606499    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-openshift-ca" pod "229b2909-25f1-46df-ac6d-61837eaf3b85" (UID: "229b2909-25f1-46df-ac6d-61837eaf3b85"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:59.650052 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.646743    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:01:59.729101 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.716359    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-xks-ca" pod "229b2909-25f1-46df-ac6d-61837eaf3b85" (UID: "229b2909-25f1-46df-ac6d-61837eaf3b85"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:59.729101 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.718395    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/229b2909-25f1-46df-ac6d-61837eaf3b85-kube-api-access-xcgff" pod "229b2909-25f1-46df-ac6d-61837eaf3b85" (UID: "229b2909-25f1-46df-ac6d-61837eaf3b85"). InnerVolumeSpecName "kube-api-access-xcgff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:59.798550 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.798507    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:59.935092 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.917749    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcgff\" (UniqueName: \"kubernetes.io/projected/229b2909-25f1-46df-ac6d-61837eaf3b85-kube-api-access-xcgff\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:59.935092 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.917798    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/229b2909-25f1-46df-ac6d-61837eaf3b85-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:01:59.957704 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.957668    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"
Oct 30 21:01:59.959261 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.959220    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b" event={"ID":"229b2909-25f1-46df-ac6d-61837eaf3b85","Type":"ContainerDied","Data":"98ad4db0cc5e56b6bc54c95c0c4e0aada2a0bd1ce489391ba2bb109eb38f3a15"}
Oct 30 21:01:59.959400 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.959351    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98ad4db0cc5e56b6bc54c95c0c4e0aada2a0bd1ce489391ba2bb109eb38f3a15"
Oct 30 21:01:59.959400 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:01:59.959377    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"]
Oct 30 21:02:00.007001 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:00.006897    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:00.068193 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:00.068145    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:00.116046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:00.071905    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:00.144170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:00.144121    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 21:02:00.144607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:00.131285    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:00.145052 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:00.144994    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:00.145462 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:00.145010    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:00.734105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:00.733164    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:00.734105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:00.733881    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:02:00.753170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:00.738920    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podUID="18730625-e6ba-421a-9a27-02acc29e9a2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.31:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:00.940969 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:00.937785    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:02:01.010422 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.010285    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:01.015484 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.015436    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 21:02:01.077193 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.077152    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:01.115631 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.115586    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 21:02:01.136333 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.135556    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:01.156142 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.156103    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 21:02:01.156364 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.154773    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:02:01.156762 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.154660    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:01.160048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.154830    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:01.161481 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.160513    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:02:01.161481 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.160585    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 21:02:01.161481 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.160626    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 21:02:01.738048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.737120    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:01.744043 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.743134    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podUID="18730625-e6ba-421a-9a27-02acc29e9a2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.31:8000/ready\": context deadline exceeded"
Oct 30 21:02:01.773047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:01.767680    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 21:02:02.039098 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:02.017499    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:02:02.072048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:02.042016    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:02:02.112050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:02.071150    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:02.162051 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:02.113814    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:02.163369 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:02.163239    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 21:02:02.163723 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:02.163696    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:02.166456 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:02.159184    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": context deadline exceeded"
Oct 30 21:02:02.167355 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:02.159219    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:02:02.168083 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:02.137116    6048 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:02.168236 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:02.128104    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Oct 30 21:02:02.739154 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:02.739105    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:02:02.760448 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:02.760401    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podUID="18730625-e6ba-421a-9a27-02acc29e9a2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.31:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.041463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:03.041366    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:03.041715 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:03.041683    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 21:02:03.051158 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:03.043485    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.142844 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:03.142796    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.171691 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:03.169125    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Oct 30 21:02:03.171691 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:03.169563    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.171691 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:03.169863    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": context deadline exceeded"
Oct 30 21:02:03.188144 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:03.188100    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.750792 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:03.749233    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:03.821048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:03.811129    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podUID="18730625-e6ba-421a-9a27-02acc29e9a2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.31:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.106106 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.051844    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.170180 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.170123    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.189418 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.189364    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.190863 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.190831    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:04.191131 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.191066    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 21:02:04.204837 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.204793    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.242049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.216993    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Oct 30 21:02:04.339049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.336368    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:04.339049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.336431    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.339049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.179257    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": context deadline exceeded"
Oct 30 21:02:04.482240 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.482142    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:04.482494 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.482466    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" podUID="649feb12-6ac4-41a1-8632-e0faa768d083" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.740136 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.740016    6048 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/health\": context deadline exceeded"
Oct 30 21:02:04.828048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.827642    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podUID="18730625-e6ba-421a-9a27-02acc29e9a2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.31:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:04.832044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:04.830943    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.118050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.066627    6048 patch_prober.go:29] interesting pod/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:05.118491 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.118451    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.118995 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.090631    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.120127 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.120104    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:05.120285 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.120263    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 21:02:05.171924 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.171877    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.190147 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.190103    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.212158 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.212110    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.308262 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.308217    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.360056 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.337567    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:05.435998 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.435861    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 21:02:05.439329 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.439304    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:02:05.610522 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.610488    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 21:02:05.611508 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.611481    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:02:05.621609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.621581    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:02:05.697111 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.692007    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm"
Oct 30 21:02:05.697111 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.696351    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 21:02:05.703267 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:05.703241    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 21:02:06.038579 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:06.036113    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:06.038579 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:06.036175    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 21:02:06.126857 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:06.126815    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx" podUID="eb2b1bb4-d4c9-408d-ac24-6510b420b4dd" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:07.035446 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:07.035400    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:02:07.035822 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:07.035469    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Oct 30 21:02:08.072970 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.072935    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"]
Oct 30 21:02:08.073597 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.073583    6048 cpu_manager.go:414] "containerMap: removing container" podUID="229b2909-25f1-46df-ac6d-61837eaf3b85" containerName="revoke-keys"
Oct 30 21:02:08.073651 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.073598    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="229b2909-25f1-46df-ac6d-61837eaf3b85" containerName="revoke-keys"
Oct 30 21:02:08.073717 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.073707    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="229b2909-25f1-46df-ac6d-61837eaf3b85" containerName="revoke-keys"
Oct 30 21:02:08.077420 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.077399    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:08.090204 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.090179    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:02:08.090402 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.090385    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:02:08.102637 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.102614    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"]
Oct 30 21:02:08.163158 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.163117    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a7b790cd-7h56g\" (UID: \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:08.163298 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.163279    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a7b790cd-7h56g\" (UID: \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:08.163365 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.163331    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxpsf\" (UniqueName: \"kubernetes.io/projected/47eed135-fe6e-43bd-b26f-4a9fd0a98676-kube-api-access-qxpsf\") pod \"maas-api-revoke-sub-a7b790cd-7h56g\" (UID: \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:08.261215 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.261179    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:02:08.261698 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.261673    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:02:08.262626 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.262602    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:02:08.264512 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.264485    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a7b790cd-7h56g\" (UID: \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:08.264618 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.264602    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a7b790cd-7h56g\" (UID: \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:08.264675 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.264661    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxpsf\" (UniqueName: \"kubernetes.io/projected/47eed135-fe6e-43bd-b26f-4a9fd0a98676-kube-api-access-qxpsf\") pod \"maas-api-revoke-sub-a7b790cd-7h56g\" (UID: \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:08.265329 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.265306    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a7b790cd-7h56g\" (UID: \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:08.266893 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.266815    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a7b790cd-7h56g\" (UID: \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:08.307237 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.307177    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxpsf\" (UniqueName: \"kubernetes.io/projected/47eed135-fe6e-43bd-b26f-4a9fd0a98676-kube-api-access-qxpsf\") pod \"maas-api-revoke-sub-a7b790cd-7h56g\" (UID: \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:08.403730 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.403636    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:08.734001 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.733967    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"]
Oct 30 21:02:08.735184 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:02:08.735156    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47eed135_fe6e_43bd_b26f_4a9fd0a98676.slice/crio-a535ed4632ff256538c42e2e83feaa3712f9938bf10e3e24377844cddf16af26 WatchSource:0}: Error finding container a535ed4632ff256538c42e2e83feaa3712f9938bf10e3e24377844cddf16af26: Status 404 returned error can't find the container with id a535ed4632ff256538c42e2e83feaa3712f9938bf10e3e24377844cddf16af26
Oct 30 21:02:08.910277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:08.910239    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g" event={"ID":"47eed135-fe6e-43bd-b26f-4a9fd0a98676","Type":"ContainerStarted","Data":"a535ed4632ff256538c42e2e83feaa3712f9938bf10e3e24377844cddf16af26"}
Oct 30 21:02:09.208618 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.208383    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"]
Oct 30 21:02:09.214114 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.214088    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:09.230756 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.229470    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"]
Oct 30 21:02:09.284528 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.284484    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fa7ba030-mbzbg\" (UID: \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:09.284885 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.284857    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fa7ba030-mbzbg\" (UID: \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:09.285264 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.285242    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fqdf\" (UniqueName: \"kubernetes.io/projected/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-kube-api-access-2fqdf\") pod \"maas-api-revoke-sub-fa7ba030-mbzbg\" (UID: \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:09.386613 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.386563    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fqdf\" (UniqueName: \"kubernetes.io/projected/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-kube-api-access-2fqdf\") pod \"maas-api-revoke-sub-fa7ba030-mbzbg\" (UID: \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:09.386889 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.386821    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fa7ba030-mbzbg\" (UID: \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:09.387001 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.386919    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fa7ba030-mbzbg\" (UID: \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:09.387773 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.387740    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fa7ba030-mbzbg\" (UID: \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:09.389325 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.389298    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fa7ba030-mbzbg\" (UID: \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:09.399159 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.399103    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fqdf\" (UniqueName: \"kubernetes.io/projected/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-kube-api-access-2fqdf\") pod \"maas-api-revoke-sub-fa7ba030-mbzbg\" (UID: \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:09.552155 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.552123    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:09.849290 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:02:09.849258    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722cb3b3_9f06_4c9c_bbe9_8497f8922f6f.slice/crio-fecb7349cee97afc7d2a869b735320f011145fd1e12f11bcd03d154ceea3b8d9 WatchSource:0}: Error finding container fecb7349cee97afc7d2a869b735320f011145fd1e12f11bcd03d154ceea3b8d9: Status 404 returned error can't find the container with id fecb7349cee97afc7d2a869b735320f011145fd1e12f11bcd03d154ceea3b8d9
Oct 30 21:02:09.849584 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.849559    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"]
Oct 30 21:02:09.920889 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.920852    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg" event={"ID":"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f","Type":"ContainerStarted","Data":"fecb7349cee97afc7d2a869b735320f011145fd1e12f11bcd03d154ceea3b8d9"}
Oct 30 21:02:09.922578 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.922547    6048 generic.go:356] "Generic (PLEG): container finished" podID="47eed135-fe6e-43bd-b26f-4a9fd0a98676" containerID="7acf9befaa9e1be4c24a59f1b07f9d9a58ce24d4ac1974a8cdc11d7254402209" exitCode=0
Oct 30 21:02:09.922720 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:09.922639    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g" event={"ID":"47eed135-fe6e-43bd-b26f-4a9fd0a98676","Type":"ContainerDied","Data":"7acf9befaa9e1be4c24a59f1b07f9d9a58ce24d4ac1974a8cdc11d7254402209"}
Oct 30 21:02:10.930956 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:10.930918    6048 generic.go:356] "Generic (PLEG): container finished" podID="722cb3b3-9f06-4c9c-bbe9-8497f8922f6f" containerID="d30836045ab0a9dbb4ff777c5a813f9a9b85492d85cd7486fa9818c5838e9a8e" exitCode=0
Oct 30 21:02:10.931400 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:10.931016    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg" event={"ID":"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f","Type":"ContainerDied","Data":"d30836045ab0a9dbb4ff777c5a813f9a9b85492d85cd7486fa9818c5838e9a8e"}
Oct 30 21:02:11.104950 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.104924    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:11.115661 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.115598    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-openshift-ca\") pod \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\" (UID: \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\") "
Oct 30 21:02:11.115785 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.115733    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-xks-ca\") pod \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\" (UID: \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\") "
Oct 30 21:02:11.115869 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.115837    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47eed135-fe6e-43bd-b26f-4a9fd0a98676-kube-api-access-qxpsf\" (UniqueName: \"kubernetes.io/projected/47eed135-fe6e-43bd-b26f-4a9fd0a98676-kube-api-access-qxpsf\") pod \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\" (UID: \"47eed135-fe6e-43bd-b26f-4a9fd0a98676\") "
Oct 30 21:02:11.115927 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.115897    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-openshift-ca" pod "47eed135-fe6e-43bd-b26f-4a9fd0a98676" (UID: "47eed135-fe6e-43bd-b26f-4a9fd0a98676"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:11.116323 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.116304    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:11.117936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.117906    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-xks-ca" pod "47eed135-fe6e-43bd-b26f-4a9fd0a98676" (UID: "47eed135-fe6e-43bd-b26f-4a9fd0a98676"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:11.118034 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.117917    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47eed135-fe6e-43bd-b26f-4a9fd0a98676-kube-api-access-qxpsf" pod "47eed135-fe6e-43bd-b26f-4a9fd0a98676" (UID: "47eed135-fe6e-43bd-b26f-4a9fd0a98676"). InnerVolumeSpecName "kube-api-access-qxpsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:11.199007 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.198975    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"]
Oct 30 21:02:11.199648 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.199634    6048 cpu_manager.go:414] "containerMap: removing container" podUID="47eed135-fe6e-43bd-b26f-4a9fd0a98676" containerName="revoke-keys"
Oct 30 21:02:11.199687 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.199649    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="47eed135-fe6e-43bd-b26f-4a9fd0a98676" containerName="revoke-keys"
Oct 30 21:02:11.199765 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.199756    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="47eed135-fe6e-43bd-b26f-4a9fd0a98676" containerName="revoke-keys"
Oct 30 21:02:11.203505 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.203484    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.217312 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.217280    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.217423 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.217325    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.217468 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.217441    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.217576 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.217558    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.217643 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.217624    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjchr\" (UniqueName: \"kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-kube-api-access-zjchr\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.217702 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.217687    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.217776 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.217759    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.217818 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.217793    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.217899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.217884    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a3a351-0d0c-44f7-9807-c4e947600c12-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.218165 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.218146    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/47eed135-fe6e-43bd-b26f-4a9fd0a98676-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:11.218249 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.218169    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxpsf\" (UniqueName: \"kubernetes.io/projected/47eed135-fe6e-43bd-b26f-4a9fd0a98676-kube-api-access-qxpsf\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:11.220396 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.220377    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"]
Oct 30 21:02:11.319529 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.319491    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a3a351-0d0c-44f7-9807-c4e947600c12-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320162 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320132    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320288 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320181    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320288 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320213    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320288 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320226    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a3a351-0d0c-44f7-9807-c4e947600c12-istiod-ca-cert\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320470 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320319    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320470 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320380    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjchr\" (UniqueName: \"kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-kube-api-access-zjchr\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320470 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320439    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320629 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320469    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-certs\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320629 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320553    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-credential-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320629 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320559    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320781 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320630    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-socket\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320781 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320646    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.320781 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.320745    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-data\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.322792 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.322768    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-envoy\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.323039 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.323008    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-podinfo\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.334475 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.334441    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-token\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.334728 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.334701    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjchr\" (UniqueName: \"kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-kube-api-access-zjchr\") pod \"e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") " pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.518814 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.518717    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:11.814943 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.814914    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"]
Oct 30 21:02:11.815252 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:02:11.815219    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a3a351_0d0c_44f7_9807_c4e947600c12.slice/crio-d80ed90ed3412f79e1c8f3a2b2dda17043276211a3024845bc143f417d9ca31e WatchSource:0}: Error finding container d80ed90ed3412f79e1c8f3a2b2dda17043276211a3024845bc143f417d9ca31e: Status 404 returned error can't find the container with id d80ed90ed3412f79e1c8f3a2b2dda17043276211a3024845bc143f417d9ca31e
Oct 30 21:02:11.817899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.817865    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:11.817974 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.817935    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:11.817974 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.817964    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:11.942608 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.942574    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"
Oct 30 21:02:11.943090 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.942577    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g" event={"ID":"47eed135-fe6e-43bd-b26f-4a9fd0a98676","Type":"ContainerDied","Data":"a535ed4632ff256538c42e2e83feaa3712f9938bf10e3e24377844cddf16af26"}
Oct 30 21:02:11.943090 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.942716    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a535ed4632ff256538c42e2e83feaa3712f9938bf10e3e24377844cddf16af26"
Oct 30 21:02:11.945014 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.944975    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" event={"ID":"c2a3a351-0d0c-44f7-9807-c4e947600c12","Type":"ContainerStarted","Data":"242de62556af269f9b23632e2dc3f29ea22e8d6920e53fa941d141b4ac4d9783"}
Oct 30 21:02:11.945206 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.945080    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" event={"ID":"c2a3a351-0d0c-44f7-9807-c4e947600c12","Type":"ContainerStarted","Data":"d80ed90ed3412f79e1c8f3a2b2dda17043276211a3024845bc143f417d9ca31e"}
Oct 30 21:02:11.976059 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:11.975415    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" podStartSLOduration=0.975396333 podStartE2EDuration="975.396333ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:11.969115587 +0000 UTC m=+1342.827851881" watchObservedRunningTime="2026-10-30 21:02:11.975396333 +0000 UTC m=+1342.834132631"
Oct 30 21:02:12.108261 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.108234    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:12.133254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.133217    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-kube-api-access-2fqdf\" (UniqueName: \"kubernetes.io/projected/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-kube-api-access-2fqdf\") pod \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\" (UID: \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\") "
Oct 30 21:02:12.133727 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.133330    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-xks-ca\") pod \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\" (UID: \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\") "
Oct 30 21:02:12.133727 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.133513    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-openshift-ca\") pod \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\" (UID: \"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f\") "
Oct 30 21:02:12.135334 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.133978    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-openshift-ca" pod "722cb3b3-9f06-4c9c-bbe9-8497f8922f6f" (UID: "722cb3b3-9f06-4c9c-bbe9-8497f8922f6f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:12.135334 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.134201    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:12.136828 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.136801    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-xks-ca" pod "722cb3b3-9f06-4c9c-bbe9-8497f8922f6f" (UID: "722cb3b3-9f06-4c9c-bbe9-8497f8922f6f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:12.137836 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.137810    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-kube-api-access-2fqdf" pod "722cb3b3-9f06-4c9c-bbe9-8497f8922f6f" (UID: "722cb3b3-9f06-4c9c-bbe9-8497f8922f6f"). InnerVolumeSpecName "kube-api-access-2fqdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:12.236121 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.236087    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fqdf\" (UniqueName: \"kubernetes.io/projected/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-kube-api-access-2fqdf\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:12.236121 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.236118    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:12.519942 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.519848    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:12.521617 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.521594    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:12.521693 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.521640    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" podUID="c2a3a351-0d0c-44f7-9807-c4e947600c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 21:02:12.973838 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.973810    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"
Oct 30 21:02:12.974242 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.973847    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg" event={"ID":"722cb3b3-9f06-4c9c-bbe9-8497f8922f6f","Type":"ContainerDied","Data":"fecb7349cee97afc7d2a869b735320f011145fd1e12f11bcd03d154ceea3b8d9"}
Oct 30 21:02:12.974242 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:12.973926    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fecb7349cee97afc7d2a869b735320f011145fd1e12f11bcd03d154ceea3b8d9"
Oct 30 21:02:13.519865 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.519826    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:13.520177 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.519896    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" podUID="c2a3a351-0d0c-44f7-9807-c4e947600c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 21:02:13.778356 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.778267    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"]
Oct 30 21:02:13.780884 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.779133    6048 cpu_manager.go:414] "containerMap: removing container" podUID="722cb3b3-9f06-4c9c-bbe9-8497f8922f6f" containerName="revoke-keys"
Oct 30 21:02:13.780884 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.779159    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="722cb3b3-9f06-4c9c-bbe9-8497f8922f6f" containerName="revoke-keys"
Oct 30 21:02:13.780884 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.779363    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="722cb3b3-9f06-4c9c-bbe9-8497f8922f6f" containerName="revoke-keys"
Oct 30 21:02:13.783160 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.783139    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"]
Oct 30 21:02:13.783268 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.783244    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:13.788222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.788084    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:02:13.788222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.788197    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:02:13.898842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.898804    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bf8x\" (UniqueName: \"kubernetes.io/projected/24f137da-f27d-466d-b79d-916d05a5c66b-kube-api-access-8bf8x\") pod \"maas-api-revoke-sub-d060d501-pp6t9\" (UID: \"24f137da-f27d-466d-b79d-916d05a5c66b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:13.899098 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.899073    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d060d501-pp6t9\" (UID: \"24f137da-f27d-466d-b79d-916d05a5c66b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:13.899167 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:13.899132    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d060d501-pp6t9\" (UID: \"24f137da-f27d-466d-b79d-916d05a5c66b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:14.001379 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.001329    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bf8x\" (UniqueName: \"kubernetes.io/projected/24f137da-f27d-466d-b79d-916d05a5c66b-kube-api-access-8bf8x\") pod \"maas-api-revoke-sub-d060d501-pp6t9\" (UID: \"24f137da-f27d-466d-b79d-916d05a5c66b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:14.001852 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.001569    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d060d501-pp6t9\" (UID: \"24f137da-f27d-466d-b79d-916d05a5c66b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:14.001852 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.001621    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d060d501-pp6t9\" (UID: \"24f137da-f27d-466d-b79d-916d05a5c66b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:14.002419 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.002395    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d060d501-pp6t9\" (UID: \"24f137da-f27d-466d-b79d-916d05a5c66b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:14.003958 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.003938    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d060d501-pp6t9\" (UID: \"24f137da-f27d-466d-b79d-916d05a5c66b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:14.013747 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.013726    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bf8x\" (UniqueName: \"kubernetes.io/projected/24f137da-f27d-466d-b79d-916d05a5c66b-kube-api-access-8bf8x\") pod \"maas-api-revoke-sub-d060d501-pp6t9\" (UID: \"24f137da-f27d-466d-b79d-916d05a5c66b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:14.109206 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.109181    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:14.415623 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.415586    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"]
Oct 30 21:02:14.416834 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:02:14.416804    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f137da_f27d_466d_b79d_916d05a5c66b.slice/crio-2cf77854baaa402bbd8d6b04da391705671d80063719e32153b77d878d92b216 WatchSource:0}: Error finding container 2cf77854baaa402bbd8d6b04da391705671d80063719e32153b77d878d92b216: Status 404 returned error can't find the container with id 2cf77854baaa402bbd8d6b04da391705671d80063719e32153b77d878d92b216
Oct 30 21:02:14.520968 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.520240    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:14.520968 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.520300    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" podUID="c2a3a351-0d0c-44f7-9807-c4e947600c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 21:02:14.600111 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.600064    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"]
Oct 30 21:02:14.618538 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.618501    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"]
Oct 30 21:02:14.991127 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.991087    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9" event={"ID":"24f137da-f27d-466d-b79d-916d05a5c66b","Type":"ContainerStarted","Data":"9656185bab607ec86372b38f252759b789f7b4166bfaca010d44f0b707053856"}
Oct 30 21:02:14.991309 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:14.991177    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9" event={"ID":"24f137da-f27d-466d-b79d-916d05a5c66b","Type":"ContainerStarted","Data":"2cf77854baaa402bbd8d6b04da391705671d80063719e32153b77d878d92b216"}
Oct 30 21:02:15.013321 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:15.013256    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9" podStartSLOduration=2.013241361 podStartE2EDuration="2.013241361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:15.010123787 +0000 UTC m=+1345.868860082" watchObservedRunningTime="2026-10-30 21:02:15.013241361 +0000 UTC m=+1345.871977654"
Oct 30 21:02:15.519819 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:15.519784    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:15.520054 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:15.519862    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" podUID="c2a3a351-0d0c-44f7-9807-c4e947600c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 21:02:15.999779 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:15.999733    6048 generic.go:356] "Generic (PLEG): container finished" podID="24f137da-f27d-466d-b79d-916d05a5c66b" containerID="9656185bab607ec86372b38f252759b789f7b4166bfaca010d44f0b707053856" exitCode=0
Oct 30 21:02:16.000002 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:15.999810    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9" event={"ID":"24f137da-f27d-466d-b79d-916d05a5c66b","Type":"ContainerDied","Data":"9656185bab607ec86372b38f252759b789f7b4166bfaca010d44f0b707053856"}
Oct 30 21:02:16.124515 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:16.124472    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx" podUID="eb2b1bb4-d4c9-408d-ac24-6510b420b4dd" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:16.519743 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:16.519701    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:16.519915 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:16.519759    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" podUID="c2a3a351-0d0c-44f7-9807-c4e947600c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 21:02:16.803547 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:02:16.803463    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:02:17.413225 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:17.413196    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:17.488847 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:17.488745    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-openshift-ca\") pod \"24f137da-f27d-466d-b79d-916d05a5c66b\" (UID: \"24f137da-f27d-466d-b79d-916d05a5c66b\") "
Oct 30 21:02:17.489007 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:17.488959    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24f137da-f27d-466d-b79d-916d05a5c66b-kube-api-access-8bf8x\" (UniqueName: \"kubernetes.io/projected/24f137da-f27d-466d-b79d-916d05a5c66b-kube-api-access-8bf8x\") pod \"24f137da-f27d-466d-b79d-916d05a5c66b\" (UID: \"24f137da-f27d-466d-b79d-916d05a5c66b\") "
Oct 30 21:02:17.489129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:17.489093    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-xks-ca\") pod \"24f137da-f27d-466d-b79d-916d05a5c66b\" (UID: \"24f137da-f27d-466d-b79d-916d05a5c66b\") "
Oct 30 21:02:17.489272 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:17.489239    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-openshift-ca" pod "24f137da-f27d-466d-b79d-916d05a5c66b" (UID: "24f137da-f27d-466d-b79d-916d05a5c66b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:17.489816 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:17.489791    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:17.491934 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:17.491904    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-xks-ca" pod "24f137da-f27d-466d-b79d-916d05a5c66b" (UID: "24f137da-f27d-466d-b79d-916d05a5c66b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:17.492067 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:17.492045    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f137da-f27d-466d-b79d-916d05a5c66b-kube-api-access-8bf8x" pod "24f137da-f27d-466d-b79d-916d05a5c66b" (UID: "24f137da-f27d-466d-b79d-916d05a5c66b"). InnerVolumeSpecName "kube-api-access-8bf8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:17.520063 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:17.519364    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:17.520063 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:17.519445    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" podUID="c2a3a351-0d0c-44f7-9807-c4e947600c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 21:02:17.591882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:17.591846    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bf8x\" (UniqueName: \"kubernetes.io/projected/24f137da-f27d-466d-b79d-916d05a5c66b-kube-api-access-8bf8x\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:17.591882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:17.591879    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/24f137da-f27d-466d-b79d-916d05a5c66b-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:18.023620 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.023569    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"
Oct 30 21:02:18.023620 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.023582    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9" event={"ID":"24f137da-f27d-466d-b79d-916d05a5c66b","Type":"ContainerDied","Data":"2cf77854baaa402bbd8d6b04da391705671d80063719e32153b77d878d92b216"}
Oct 30 21:02:18.023886 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.023641    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cf77854baaa402bbd8d6b04da391705671d80063719e32153b77d878d92b216"
Oct 30 21:02:18.447342 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.447312    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"
Oct 30 21:02:18.504827 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.504795    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-plugins-config-volume\") pod \"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd\" (UID: \"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd\") "
Oct 30 21:02:18.505115 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.505093    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-kube-api-access-rwz6n\" (UniqueName: \"kubernetes.io/projected/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-kube-api-access-rwz6n\") pod \"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd\" (UID: \"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd\") "
Oct 30 21:02:18.505247 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.505228    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-plugins-config-volume" pod "eb2b1bb4-d4c9-408d-ac24-6510b420b4dd" (UID: "eb2b1bb4-d4c9-408d-ac24-6510b420b4dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:18.505689 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.505666    6048 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-plugins-config-volume\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:18.507849 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.507824    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-kube-api-access-rwz6n" pod "eb2b1bb4-d4c9-408d-ac24-6510b420b4dd" (UID: "eb2b1bb4-d4c9-408d-ac24-6510b420b4dd"). InnerVolumeSpecName "kube-api-access-rwz6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:18.519535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.519503    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:02:18.519671 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.519574    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" podUID="c2a3a351-0d0c-44f7-9807-c4e947600c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Oct 30 21:02:18.607694 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.607660    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwz6n\" (UniqueName: \"kubernetes.io/projected/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd-kube-api-access-rwz6n\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:18.799043 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:18.798207    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" containerID="cri-o://ee7a5146537aa6c666391a0aaa9d23007bf93e6cbc230b104aae8b920db29002" gracePeriod=42
Oct 30 21:02:19.038322 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.038116    6048 generic.go:356] "Generic (PLEG): container finished" podID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerID="ee7a5146537aa6c666391a0aaa9d23007bf93e6cbc230b104aae8b920db29002" exitCode=0
Oct 30 21:02:19.038477 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.038350    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" event={"ID":"5bc9653c-9d66-4407-aa8d-f3109feaa0d9","Type":"ContainerDied","Data":"ee7a5146537aa6c666391a0aaa9d23007bf93e6cbc230b104aae8b920db29002"}
Oct 30 21:02:19.040281 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.040252    6048 generic.go:356] "Generic (PLEG): container finished" podID="eb2b1bb4-d4c9-408d-ac24-6510b420b4dd" containerID="c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0" exitCode=0
Oct 30 21:02:19.040452 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.040337    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx" event={"ID":"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd","Type":"ContainerDied","Data":"c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0"}
Oct 30 21:02:19.040452 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.040384    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx" event={"ID":"eb2b1bb4-d4c9-408d-ac24-6510b420b4dd","Type":"ContainerDied","Data":"6d28cb7049d765bdecacfc17ae05401e6487b1976ed9dbaf1d1b01f758ded2a3"}
Oct 30 21:02:19.040452 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.040412    6048 scope.go:122] "RemoveContainer" containerID="c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0"
Oct 30 21:02:19.040624 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.040575    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"
Oct 30 21:02:19.094085 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.091734    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"]
Oct 30 21:02:19.094085 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.093311    6048 scope.go:122] "RemoveContainer" containerID="c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0"
Oct 30 21:02:19.094085 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:02:19.093656    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0\": container with ID starting with c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0 not found: ID does not exist" containerID="c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0"
Oct 30 21:02:19.094085 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.093701    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0"} err="failed to get container status \"c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0\": rpc error: code = NotFound desc = could not find container \"c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0\": container with ID starting with c2a6ee28c257afd2e61d3c3a2a852ee0691b5998fd27c2de63d238c545230aa0 not found: ID does not exist"
Oct 30 21:02:19.100615 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.100588    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-39fb96-f97df5484-x7xnx"]
Oct 30 21:02:19.154941 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.154908    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 21:02:19.219947 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.219860    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tmp-dir\") pod \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") "
Oct 30 21:02:19.219947 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.219903    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-dshm\") pod \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") "
Oct 30 21:02:19.220227 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.219974    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-kube-api-access-wlds2\" (UniqueName: \"kubernetes.io/projected/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-kube-api-access-wlds2\") pod \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") "
Oct 30 21:02:19.220227 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.220162    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-model-cache\") pod \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") "
Oct 30 21:02:19.220227 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.220211    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-home\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-home\") pod \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") "
Oct 30 21:02:19.220482 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.220391    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tls-certs\") pod \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\" (UID: \"5bc9653c-9d66-4407-aa8d-f3109feaa0d9\") "
Oct 30 21:02:19.221289 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.221260    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tmp-dir" pod "5bc9653c-9d66-4407-aa8d-f3109feaa0d9" (UID: "5bc9653c-9d66-4407-aa8d-f3109feaa0d9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:19.221621 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.221599    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-model-cache" pod "5bc9653c-9d66-4407-aa8d-f3109feaa0d9" (UID: "5bc9653c-9d66-4407-aa8d-f3109feaa0d9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:19.223797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.223774    6048 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tmp-dir\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:19.223927 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.223915    6048 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-model-cache\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:19.224222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.224203    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-home" pod "5bc9653c-9d66-4407-aa8d-f3109feaa0d9" (UID: "5bc9653c-9d66-4407-aa8d-f3109feaa0d9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:19.226214 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.226179    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tls-certs" pod "5bc9653c-9d66-4407-aa8d-f3109feaa0d9" (UID: "5bc9653c-9d66-4407-aa8d-f3109feaa0d9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:19.226521 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.226489    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-kube-api-access-wlds2" pod "5bc9653c-9d66-4407-aa8d-f3109feaa0d9" (UID: "5bc9653c-9d66-4407-aa8d-f3109feaa0d9"). InnerVolumeSpecName "kube-api-access-wlds2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:19.229645 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.229597    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-dshm" pod "5bc9653c-9d66-4407-aa8d-f3109feaa0d9" (UID: "5bc9653c-9d66-4407-aa8d-f3109feaa0d9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:19.266460 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.266424    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eb2b1bb4-d4c9-408d-ac24-6510b420b4dd" path="/var/lib/kubelet/pods/eb2b1bb4-d4c9-408d-ac24-6510b420b4dd/volumes"
Oct 30 21:02:19.318694 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.318654    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"]
Oct 30 21:02:19.319666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.319637    6048 cpu_manager.go:414] "containerMap: removing container" podUID="eb2b1bb4-d4c9-408d-ac24-6510b420b4dd" containerName="payload-processing"
Oct 30 21:02:19.319666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.319663    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eb2b1bb4-d4c9-408d-ac24-6510b420b4dd" containerName="payload-processing"
Oct 30 21:02:19.319841 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.319679    6048 cpu_manager.go:414] "containerMap: removing container" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main"
Oct 30 21:02:19.319841 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.319687    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main"
Oct 30 21:02:19.319841 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.319720    6048 cpu_manager.go:414] "containerMap: removing container" podUID="24f137da-f27d-466d-b79d-916d05a5c66b" containerName="revoke-keys"
Oct 30 21:02:19.319841 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.319726    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24f137da-f27d-466d-b79d-916d05a5c66b" containerName="revoke-keys"
Oct 30 21:02:19.319841 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.319827    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="24f137da-f27d-466d-b79d-916d05a5c66b" containerName="revoke-keys"
Oct 30 21:02:19.320008 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.319843    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="eb2b1bb4-d4c9-408d-ac24-6510b420b4dd" containerName="payload-processing"
Oct 30 21:02:19.320008 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.319852    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main"
Oct 30 21:02:19.324454 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.324423    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:19.329335 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.326299    6048 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-home\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:19.329335 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.326324    6048 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-tls-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:19.329335 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.326337    6048 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-dshm\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:19.329335 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.326353    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlds2\" (UniqueName: \"kubernetes.io/projected/5bc9653c-9d66-4407-aa8d-f3109feaa0d9-kube-api-access-wlds2\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:19.330919 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.330105    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:02:19.331260 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.331239    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:02:19.333616 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.333583    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"]
Oct 30 21:02:19.427804 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.427769    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnbxf\" (UniqueName: \"kubernetes.io/projected/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-kube-api-access-qnbxf\") pod \"maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm\" (UID: \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:19.427931 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.427861    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm\" (UID: \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:19.428054 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.427999    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm\" (UID: \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:19.523616 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.523538    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:19.524083 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.524012    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:19.524763 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.524743    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:02:19.529211 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.529189    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnbxf\" (UniqueName: \"kubernetes.io/projected/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-kube-api-access-qnbxf\") pod \"maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm\" (UID: \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:19.529296 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.529220    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm\" (UID: \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:19.529337 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.529295    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm\" (UID: \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:19.529972 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.529955    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm\" (UID: \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:19.531576 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.531559    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm\" (UID: \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:19.541303 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.541282    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnbxf\" (UniqueName: \"kubernetes.io/projected/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-kube-api-access-qnbxf\") pod \"maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm\" (UID: \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:19.661245 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.661214    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:19.953997 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:02:19.953968    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2201cfee_77ba_46b7_b508_efbdaa6c8dd1.slice/crio-414c9c1b26ee783376318bbc3d6980df27fb45c6325c84d3e0479192e33e5568 WatchSource:0}: Error finding container 414c9c1b26ee783376318bbc3d6980df27fb45c6325c84d3e0479192e33e5568: Status 404 returned error can't find the container with id 414c9c1b26ee783376318bbc3d6980df27fb45c6325c84d3e0479192e33e5568
Oct 30 21:02:19.954299 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:19.954270    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"]
Oct 30 21:02:20.049858 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:20.049807    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:20.052687 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:20.052652    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm" event={"ID":"5bc9653c-9d66-4407-aa8d-f3109feaa0d9","Type":"ContainerDied","Data":"c0d15b235ce534f79f6f827ead6e2f5e083b326ee3677cfecb1c2cd7d3dff4f9"}
Oct 30 21:02:20.052883 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:20.052700    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"
Oct 30 21:02:20.052883 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:20.052720    6048 scope.go:122] "RemoveContainer" containerID="ee7a5146537aa6c666391a0aaa9d23007bf93e6cbc230b104aae8b920db29002"
Oct 30 21:02:20.057150 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:20.057124    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm" event={"ID":"2201cfee-77ba-46b7-b508-efbdaa6c8dd1","Type":"ContainerStarted","Data":"414c9c1b26ee783376318bbc3d6980df27fb45c6325c84d3e0479192e33e5568"}
Oct 30 21:02:20.080114 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:20.080087    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"]
Oct 30 21:02:20.085464 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:20.085441    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-32a969/premium-w2-32a969-kserve-c6ccdb5b6-bl8tm"]
Oct 30 21:02:21.080140 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:21.080100    6048 generic.go:356] "Generic (PLEG): container finished" podID="2201cfee-77ba-46b7-b508-efbdaa6c8dd1" containerID="3c29da7ef8701f220b4dd9dd85ba83a760d312518ff85b66d5ff3983150ff2c8" exitCode=0
Oct 30 21:02:21.080592 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:21.080175    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm" event={"ID":"2201cfee-77ba-46b7-b508-efbdaa6c8dd1","Type":"ContainerDied","Data":"3c29da7ef8701f220b4dd9dd85ba83a760d312518ff85b66d5ff3983150ff2c8"}
Oct 30 21:02:21.260054 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:21.259951    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5bc9653c-9d66-4407-aa8d-f3109feaa0d9" path="/var/lib/kubelet/pods/5bc9653c-9d66-4407-aa8d-f3109feaa0d9/volumes"
Oct 30 21:02:22.345597 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:22.345464    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:22.437756 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:22.437669    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"]
Oct 30 21:02:22.449442 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:22.449409    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-39fb96-cj9vx"]
Oct 30 21:02:22.486374 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:22.486339    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-openshift-ca\") pod \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\" (UID: \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\") "
Oct 30 21:02:22.486543 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:22.486499    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-xks-ca\") pod \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\" (UID: \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\") "
Oct 30 21:02:22.486543 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:22.486532    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-kube-api-access-qnbxf\" (UniqueName: \"kubernetes.io/projected/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-kube-api-access-qnbxf\") pod \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\" (UID: \"2201cfee-77ba-46b7-b508-efbdaa6c8dd1\") "
Oct 30 21:02:22.486767 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:22.486736    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-openshift-ca" pod "2201cfee-77ba-46b7-b508-efbdaa6c8dd1" (UID: "2201cfee-77ba-46b7-b508-efbdaa6c8dd1"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:22.487110 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:22.487067    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:22.488594 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:22.488570    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-xks-ca" pod "2201cfee-77ba-46b7-b508-efbdaa6c8dd1" (UID: "2201cfee-77ba-46b7-b508-efbdaa6c8dd1"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:22.488745 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:22.488723    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-kube-api-access-qnbxf" pod "2201cfee-77ba-46b7-b508-efbdaa6c8dd1" (UID: "2201cfee-77ba-46b7-b508-efbdaa6c8dd1"). InnerVolumeSpecName "kube-api-access-qnbxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:22.588609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:22.588563    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:22.588609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:22.588596    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnbxf\" (UniqueName: \"kubernetes.io/projected/2201cfee-77ba-46b7-b508-efbdaa6c8dd1-kube-api-access-qnbxf\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:23.108851 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:23.108810    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm" event={"ID":"2201cfee-77ba-46b7-b508-efbdaa6c8dd1","Type":"ContainerDied","Data":"414c9c1b26ee783376318bbc3d6980df27fb45c6325c84d3e0479192e33e5568"}
Oct 30 21:02:23.108851 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:23.108839    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"
Oct 30 21:02:23.109124 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:23.108872    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="414c9c1b26ee783376318bbc3d6980df27fb45c6325c84d3e0479192e33e5568"
Oct 30 21:02:23.259884 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:23.259850    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2af62151-d35d-4b7c-ad00-46e563b277ef" path="/var/lib/kubelet/pods/2af62151-d35d-4b7c-ad00-46e563b277ef/volumes"
Oct 30 21:02:24.498299 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.498267    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"]
Oct 30 21:02:24.498959 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.498944    6048 cpu_manager.go:414] "containerMap: removing container" podUID="2201cfee-77ba-46b7-b508-efbdaa6c8dd1" containerName="revoke-keys"
Oct 30 21:02:24.499004 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.498960    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2201cfee-77ba-46b7-b508-efbdaa6c8dd1" containerName="revoke-keys"
Oct 30 21:02:24.499091 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.499080    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="2201cfee-77ba-46b7-b508-efbdaa6c8dd1" containerName="revoke-keys"
Oct 30 21:02:24.502925 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.502903    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:24.516056 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.516009    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"]
Oct 30 21:02:24.527798 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.527768    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:02:24.527931 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.527804    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:02:24.623720 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.623685    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dbca169a-g6hkx\" (UID: \"1892700d-9b18-4189-81d9-d414b98ed7d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:24.623896 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.623740    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dbca169a-g6hkx\" (UID: \"1892700d-9b18-4189-81d9-d414b98ed7d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:24.623937 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.623898    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdhr7\" (UniqueName: \"kubernetes.io/projected/1892700d-9b18-4189-81d9-d414b98ed7d9-kube-api-access-fdhr7\") pod \"maas-api-revoke-sub-dbca169a-g6hkx\" (UID: \"1892700d-9b18-4189-81d9-d414b98ed7d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:24.725817 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.725780    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdhr7\" (UniqueName: \"kubernetes.io/projected/1892700d-9b18-4189-81d9-d414b98ed7d9-kube-api-access-fdhr7\") pod \"maas-api-revoke-sub-dbca169a-g6hkx\" (UID: \"1892700d-9b18-4189-81d9-d414b98ed7d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:24.726057 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.726008    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dbca169a-g6hkx\" (UID: \"1892700d-9b18-4189-81d9-d414b98ed7d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:24.726161 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.726080    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dbca169a-g6hkx\" (UID: \"1892700d-9b18-4189-81d9-d414b98ed7d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:24.726648 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.726622    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dbca169a-g6hkx\" (UID: \"1892700d-9b18-4189-81d9-d414b98ed7d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:24.728497 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.728474    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dbca169a-g6hkx\" (UID: \"1892700d-9b18-4189-81d9-d414b98ed7d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:24.742683 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.742662    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdhr7\" (UniqueName: \"kubernetes.io/projected/1892700d-9b18-4189-81d9-d414b98ed7d9-kube-api-access-fdhr7\") pod \"maas-api-revoke-sub-dbca169a-g6hkx\" (UID: \"1892700d-9b18-4189-81d9-d414b98ed7d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:24.818908 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.818865    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:24.849624 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:24.849578    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"]
Oct 30 21:02:25.121202 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.117970    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"]
Oct 30 21:02:25.132444 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:02:25.132406    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1892700d_9b18_4189_81d9_d414b98ed7d9.slice/crio-a88987f1b2138948e3e2818c2eaf5a38bb7cff324e5d22f78a89cba64c102392 WatchSource:0}: Error finding container a88987f1b2138948e3e2818c2eaf5a38bb7cff324e5d22f78a89cba64c102392: Status 404 returned error can't find the container with id a88987f1b2138948e3e2818c2eaf5a38bb7cff324e5d22f78a89cba64c102392
Oct 30 21:02:25.506749 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.506712    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"]
Oct 30 21:02:25.512087 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.512017    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.546901 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.546873    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"]
Oct 30 21:02:25.643413 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.643374    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.643581 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.643502    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.643666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.643596    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.643780 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.643752    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.643874 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.643859    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.643911 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.643884    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.643975 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.643909    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.644033 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.643992    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.644081 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.644012    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdgjk\" (UniqueName: \"kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-kube-api-access-tdgjk\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.745588 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.745511    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.745588 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.745551    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdgjk\" (UniqueName: \"kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-kube-api-access-tdgjk\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.745785 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.745627    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.745785 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.745690    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.745925 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.745792    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.745925 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.745875    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.746052 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.745955    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.746052 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.745965    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.746052 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.745978    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.746052 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.746016    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.746269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.746173    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.746418 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.746392    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.746480 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.746455    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.746663 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.746640    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.748041 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.747995    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.748794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.748767    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.758159 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.758138    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.758257 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.758189    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdgjk\" (UniqueName: \"kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-kube-api-access-tdgjk\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:25.857732 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:25.857703    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:26.146687 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.146657    6048 generic.go:356] "Generic (PLEG): container finished" podID="1892700d-9b18-4189-81d9-d414b98ed7d9" containerID="b79f77081e7f6ccbc258d398ee54320f582c34fa842bac455d8dc3ce65747f46" exitCode=0
Oct 30 21:02:26.146892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.146742    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx" event={"ID":"1892700d-9b18-4189-81d9-d414b98ed7d9","Type":"ContainerDied","Data":"b79f77081e7f6ccbc258d398ee54320f582c34fa842bac455d8dc3ce65747f46"}
Oct 30 21:02:26.146892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.146797    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx" event={"ID":"1892700d-9b18-4189-81d9-d414b98ed7d9","Type":"ContainerStarted","Data":"a88987f1b2138948e3e2818c2eaf5a38bb7cff324e5d22f78a89cba64c102392"}
Oct 30 21:02:26.158668 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.158628    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"]
Oct 30 21:02:26.165467 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:02:26.164309    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1d4ca7_3f79_4a4d_8661_8aed3d850449.slice/crio-ffa7c352a0c755d2d0bf66a1ca3093196701725361e14a27c7ca77bf755907bc WatchSource:0}: Error finding container ffa7c352a0c755d2d0bf66a1ca3093196701725361e14a27c7ca77bf755907bc: Status 404 returned error can't find the container with id ffa7c352a0c755d2d0bf66a1ca3093196701725361e14a27c7ca77bf755907bc
Oct 30 21:02:26.167739 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.167702    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:26.167853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.167777    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:26.167853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.167814    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:26.307510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.307042    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"]
Oct 30 21:02:26.312722 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.312690    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.333562 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.331182    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"]
Oct 30 21:02:26.368160 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.368120    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.368429 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.368410    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.368560 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.368547    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.368736 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.368721    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a61036c-ce15-46cb-a653-fabd401a29d3-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.368933 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.368916    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5btbz\" (UniqueName: \"kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-kube-api-access-5btbz\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.369063 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.369049    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.369170 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.369157    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.369284 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.369272    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.369463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.369450    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.474980    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a61036c-ce15-46cb-a653-fabd401a29d3-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.475137    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5btbz\" (UniqueName: \"kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-kube-api-access-5btbz\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.475176    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.475210    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.475240    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.475367    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.475400    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.475466    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.475509    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.475703    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.475793    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-data\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.476000    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-credential-socket\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.476853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.476551    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-certs\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.478177 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.477075    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a61036c-ce15-46cb-a653-fabd401a29d3-istiod-ca-cert\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.490742 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.490710    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-envoy\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.493862 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.493809    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-podinfo\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.495235 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.495198    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-token\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.495786 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.495751    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5btbz\" (UniqueName: \"kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-kube-api-access-5btbz\") pod \"e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") " pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.636468 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.636380    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:26.966314 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.966277    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"]
Oct 30 21:02:26.969207 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:02:26.969172    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a61036c_ce15_46cb_a653_fabd401a29d3.slice/crio-b3d8e959d6de10fe71fdc1ad6cfae54239ac8caf8d488060d54e9ab5cc8a48aa WatchSource:0}: Error finding container b3d8e959d6de10fe71fdc1ad6cfae54239ac8caf8d488060d54e9ab5cc8a48aa: Status 404 returned error can't find the container with id b3d8e959d6de10fe71fdc1ad6cfae54239ac8caf8d488060d54e9ab5cc8a48aa
Oct 30 21:02:26.973359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.973307    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:26.973476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.973422    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:26.973531 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:26.973478    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:27.198235 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.198199    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" event={"ID":"2a61036c-ce15-46cb-a653-fabd401a29d3","Type":"ContainerStarted","Data":"11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57"}
Oct 30 21:02:27.198462 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.198265    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" event={"ID":"2a61036c-ce15-46cb-a653-fabd401a29d3","Type":"ContainerStarted","Data":"b3d8e959d6de10fe71fdc1ad6cfae54239ac8caf8d488060d54e9ab5cc8a48aa"}
Oct 30 21:02:27.215246 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.215133    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" event={"ID":"2e1d4ca7-3f79-4a4d-8661-8aed3d850449","Type":"ContainerStarted","Data":"5a5ad3e4d97ce1a7f9320e75b3f906ad6e2bac95790d34bfbbf4ffab8d220f44"}
Oct 30 21:02:27.217388 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.217360    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" event={"ID":"2e1d4ca7-3f79-4a4d-8661-8aed3d850449","Type":"ContainerStarted","Data":"ffa7c352a0c755d2d0bf66a1ca3093196701725361e14a27c7ca77bf755907bc"}
Oct 30 21:02:27.233913 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.233852    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podStartSLOduration=1.233832916 podStartE2EDuration="1.233832916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:27.227597728 +0000 UTC m=+1358.086334024" watchObservedRunningTime="2026-10-30 21:02:27.233832916 +0000 UTC m=+1358.092569208"
Oct 30 21:02:27.328789 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.328680    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podStartSLOduration=2.328658641 podStartE2EDuration="2.328658641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:27.317201553 +0000 UTC m=+1358.175937872" watchObservedRunningTime="2026-10-30 21:02:27.328658641 +0000 UTC m=+1358.187394937"
Oct 30 21:02:27.592551 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.592521    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:27.630092 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.630062    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-openshift-ca\") pod \"1892700d-9b18-4189-81d9-d414b98ed7d9\" (UID: \"1892700d-9b18-4189-81d9-d414b98ed7d9\") "
Oct 30 21:02:27.630283 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.630109    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-xks-ca\") pod \"1892700d-9b18-4189-81d9-d414b98ed7d9\" (UID: \"1892700d-9b18-4189-81d9-d414b98ed7d9\") "
Oct 30 21:02:27.630283 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.630277    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1892700d-9b18-4189-81d9-d414b98ed7d9-kube-api-access-fdhr7\" (UniqueName: \"kubernetes.io/projected/1892700d-9b18-4189-81d9-d414b98ed7d9-kube-api-access-fdhr7\") pod \"1892700d-9b18-4189-81d9-d414b98ed7d9\" (UID: \"1892700d-9b18-4189-81d9-d414b98ed7d9\") "
Oct 30 21:02:27.631135 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.631102    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-openshift-ca" pod "1892700d-9b18-4189-81d9-d414b98ed7d9" (UID: "1892700d-9b18-4189-81d9-d414b98ed7d9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:27.633145 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.633115    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-xks-ca" pod "1892700d-9b18-4189-81d9-d414b98ed7d9" (UID: "1892700d-9b18-4189-81d9-d414b98ed7d9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:27.633465 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.633436    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1892700d-9b18-4189-81d9-d414b98ed7d9-kube-api-access-fdhr7" pod "1892700d-9b18-4189-81d9-d414b98ed7d9" (UID: "1892700d-9b18-4189-81d9-d414b98ed7d9"). InnerVolumeSpecName "kube-api-access-fdhr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:27.637567 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.637540    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:27.732063 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.732014    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdhr7\" (UniqueName: \"kubernetes.io/projected/1892700d-9b18-4189-81d9-d414b98ed7d9-kube-api-access-fdhr7\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:27.732063 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.732061    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:27.732269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.732072    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1892700d-9b18-4189-81d9-d414b98ed7d9-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:27.858482 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.858444    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:27.867204 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.867164    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:02:27.867395 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:27.867236    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 21:02:28.111436 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.111343    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"]
Oct 30 21:02:28.111607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.111583    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt" podUID="a99f6390-6609-4125-bac3-2e347b8fa7bf" containerName="maas-api" containerID="cri-o://b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf" gracePeriod=30
Oct 30 21:02:28.227470 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.227370    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"
Oct 30 21:02:28.227849 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.227823    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx" event={"ID":"1892700d-9b18-4189-81d9-d414b98ed7d9","Type":"ContainerDied","Data":"a88987f1b2138948e3e2818c2eaf5a38bb7cff324e5d22f78a89cba64c102392"}
Oct 30 21:02:28.227909 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.227879    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a88987f1b2138948e3e2818c2eaf5a38bb7cff324e5d22f78a89cba64c102392"
Oct 30 21:02:28.686119 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.684861    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"]
Oct 30 21:02:28.721047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.710296    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:02:28.721047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.710360    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Oct 30 21:02:28.830434 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.829165    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"]
Oct 30 21:02:28.890200 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.861665    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:02:28.890200 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.861723    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 21:02:28.910118 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.910083    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 21:02:28.985144 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.984185    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-metrics-certs\") pod \"a99f6390-6609-4125-bac3-2e347b8fa7bf\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") "
Oct 30 21:02:28.985144 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.984483    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-maas-api-tls\") pod \"a99f6390-6609-4125-bac3-2e347b8fa7bf\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") "
Oct 30 21:02:28.985144 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.984597    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a99f6390-6609-4125-bac3-2e347b8fa7bf-kube-api-access-h9qpn\" (UniqueName: \"kubernetes.io/projected/a99f6390-6609-4125-bac3-2e347b8fa7bf-kube-api-access-h9qpn\") pod \"a99f6390-6609-4125-bac3-2e347b8fa7bf\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") "
Oct 30 21:02:28.985144 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.984656    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a99f6390-6609-4125-bac3-2e347b8fa7bf-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a99f6390-6609-4125-bac3-2e347b8fa7bf-openshift-service-ca\") pod \"a99f6390-6609-4125-bac3-2e347b8fa7bf\" (UID: \"a99f6390-6609-4125-bac3-2e347b8fa7bf\") "
Oct 30 21:02:28.999009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:28.998693    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-metrics-certs" pod "a99f6390-6609-4125-bac3-2e347b8fa7bf" (UID: "a99f6390-6609-4125-bac3-2e347b8fa7bf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:29.000964 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.000227    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a99f6390-6609-4125-bac3-2e347b8fa7bf-openshift-service-ca" pod "a99f6390-6609-4125-bac3-2e347b8fa7bf" (UID: "a99f6390-6609-4125-bac3-2e347b8fa7bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:29.002616 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.002579    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a99f6390-6609-4125-bac3-2e347b8fa7bf-kube-api-access-h9qpn" pod "a99f6390-6609-4125-bac3-2e347b8fa7bf" (UID: "a99f6390-6609-4125-bac3-2e347b8fa7bf"). InnerVolumeSpecName "kube-api-access-h9qpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:29.003013 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.002981    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-maas-api-tls" pod "a99f6390-6609-4125-bac3-2e347b8fa7bf" (UID: "a99f6390-6609-4125-bac3-2e347b8fa7bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:29.105086 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.099350    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-maas-api-tls\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:29.105086 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.099392    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9qpn\" (UniqueName: \"kubernetes.io/projected/a99f6390-6609-4125-bac3-2e347b8fa7bf-kube-api-access-h9qpn\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:29.105086 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.099411    6048 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a99f6390-6609-4125-bac3-2e347b8fa7bf-openshift-service-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:29.105086 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.099430    6048 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a99f6390-6609-4125-bac3-2e347b8fa7bf-metrics-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:29.239905 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.237769    6048 generic.go:356] "Generic (PLEG): container finished" podID="a99f6390-6609-4125-bac3-2e347b8fa7bf" containerID="b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf" exitCode=0
Oct 30 21:02:29.239905 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.237924    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt" event={"ID":"a99f6390-6609-4125-bac3-2e347b8fa7bf","Type":"ContainerDied","Data":"b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf"}
Oct 30 21:02:29.239905 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.237990    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt" event={"ID":"a99f6390-6609-4125-bac3-2e347b8fa7bf","Type":"ContainerDied","Data":"32af6a963e6c5ccda0a1156605fcd130b41ce9d9f6cfb548dcfe22ae874e3f5c"}
Oct 30 21:02:29.239905 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.238033    6048 scope.go:122] "RemoveContainer" containerID="b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf"
Oct 30 21:02:29.239905 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.238204    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"
Oct 30 21:02:29.324307 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.323757    6048 scope.go:122] "RemoveContainer" containerID="b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf"
Oct 30 21:02:29.324307 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:02:29.324200    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf\": container with ID starting with b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf not found: ID does not exist" containerID="b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf"
Oct 30 21:02:29.324307 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.324238    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf"} err="failed to get container status \"b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf\": rpc error: code = NotFound desc = could not find container \"b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf\": container with ID starting with b735bb0a2ff6fd8d16e40761db9ddd0919a0ee670134b2f8de2f6f11080f5ecf not found: ID does not exist"
Oct 30 21:02:29.411126 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.411089    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"]
Oct 30 21:02:29.417570 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.417537    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-32a969-8ffb86d89-j8qmt"]
Oct 30 21:02:29.607787 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.607747    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"]
Oct 30 21:02:29.635933 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.635887    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"]
Oct 30 21:02:29.636834 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.636805    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:02:29.636963 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.636851    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Oct 30 21:02:29.712274 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.712220    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" containerID="cri-o://932fae69af880a90763f428ed8770e68957310fa77f8ecffee1f69da2d7133a6" gracePeriod=45
Oct 30 21:02:29.712769 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.712388    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" containerID="cri-o://6c8e0bb30d757a1cf88a0b0ccb0aafdd2438f59ab646b713a5819f365cdad763" gracePeriod=45
Oct 30 21:02:29.890262 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.887011    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:02:29.890262 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:29.887087    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 21:02:30.214135 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:30.197611    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.77:8000/ready\": dial tcp 10.134.0.77:8000: connect: connection refused"
Oct 30 21:02:30.214135 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:30.197937    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": dial tcp 10.134.0.50:8000: connect: connection refused"
Oct 30 21:02:30.696250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:30.694304    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:02:30.696250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:30.694487    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Oct 30 21:02:30.722062 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:30.720857    6048 generic.go:356] "Generic (PLEG): container finished" podID="5f013308-5885-4d09-8947-6bbd783fba1b" containerID="932fae69af880a90763f428ed8770e68957310fa77f8ecffee1f69da2d7133a6" exitCode=0
Oct 30 21:02:30.722062 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:30.721008    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" event={"ID":"5f013308-5885-4d09-8947-6bbd783fba1b","Type":"ContainerDied","Data":"932fae69af880a90763f428ed8770e68957310fa77f8ecffee1f69da2d7133a6"}
Oct 30 21:02:30.845150 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:30.827545    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"]
Oct 30 21:02:30.845150 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:30.827799    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" podUID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" containerName="istio-proxy" containerID="cri-o://4e4a21d19eca6ac961dcd3ad879c3d90a3900975bba9c22a8b2ba08d42f075bd" gracePeriod=30
Oct 30 21:02:30.845150 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:30.837403    6048 generic.go:356] "Generic (PLEG): container finished" podID="727e1989-a102-468c-af84-a86c761a4135" containerID="6c8e0bb30d757a1cf88a0b0ccb0aafdd2438f59ab646b713a5819f365cdad763" exitCode=0
Oct 30 21:02:30.845150 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:30.837509    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" event={"ID":"727e1989-a102-468c-af84-a86c761a4135","Type":"ContainerDied","Data":"6c8e0bb30d757a1cf88a0b0ccb0aafdd2438f59ab646b713a5819f365cdad763"}
Oct 30 21:02:30.927487 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:30.927450    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:02:30.927630 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:30.927520    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 21:02:31.028917 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.028628    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:02:31.033249 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.033173    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.131451    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/727e1989-a102-468c-af84-a86c761a4135-tls-certs\" (UniqueName: \"kubernetes.io/secret/727e1989-a102-468c-af84-a86c761a4135-tls-certs\") pod \"727e1989-a102-468c-af84-a86c761a4135\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") "
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.131504    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-dshm\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-dshm\") pod \"727e1989-a102-468c-af84-a86c761a4135\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") "
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.131545    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-home\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-home\") pod \"727e1989-a102-468c-af84-a86c761a4135\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") "
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.131772    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-home" pod "727e1989-a102-468c-af84-a86c761a4135" (UID: "727e1989-a102-468c-af84-a86c761a4135"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132018    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-tmp-dir\") pod \"727e1989-a102-468c-af84-a86c761a4135\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") "
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132095    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-tmp-dir\") pod \"5f013308-5885-4d09-8947-6bbd783fba1b\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") "
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132142    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-home\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-home\") pod \"5f013308-5885-4d09-8947-6bbd783fba1b\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") "
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132209    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5f013308-5885-4d09-8947-6bbd783fba1b-tls-certs\" (UniqueName: \"kubernetes.io/secret/5f013308-5885-4d09-8947-6bbd783fba1b-tls-certs\") pod \"5f013308-5885-4d09-8947-6bbd783fba1b\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") "
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132277    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-model-cache\") pod \"5f013308-5885-4d09-8947-6bbd783fba1b\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") "
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132381    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-dshm\") pod \"5f013308-5885-4d09-8947-6bbd783fba1b\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") "
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132430    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-tmp-dir" pod "5f013308-5885-4d09-8947-6bbd783fba1b" (UID: "5f013308-5885-4d09-8947-6bbd783fba1b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132453    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-model-cache\") pod \"727e1989-a102-468c-af84-a86c761a4135\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") "
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132502    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/727e1989-a102-468c-af84-a86c761a4135-kube-api-access-s72wk\" (UniqueName: \"kubernetes.io/projected/727e1989-a102-468c-af84-a86c761a4135-kube-api-access-s72wk\") pod \"727e1989-a102-468c-af84-a86c761a4135\" (UID: \"727e1989-a102-468c-af84-a86c761a4135\") "
Oct 30 21:02:31.132555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132534    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f013308-5885-4d09-8947-6bbd783fba1b-kube-api-access-rkslz\" (UniqueName: \"kubernetes.io/projected/5f013308-5885-4d09-8947-6bbd783fba1b-kube-api-access-rkslz\") pod \"5f013308-5885-4d09-8947-6bbd783fba1b\" (UID: \"5f013308-5885-4d09-8947-6bbd783fba1b\") "
Oct 30 21:02:31.133357 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132604    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-tmp-dir" pod "727e1989-a102-468c-af84-a86c761a4135" (UID: "727e1989-a102-468c-af84-a86c761a4135"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:31.133357 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132769    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-model-cache" pod "5f013308-5885-4d09-8947-6bbd783fba1b" (UID: "5f013308-5885-4d09-8947-6bbd783fba1b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:31.133357 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.132923    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-home" pod "5f013308-5885-4d09-8947-6bbd783fba1b" (UID: "5f013308-5885-4d09-8947-6bbd783fba1b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:31.134530 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.133576    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-model-cache" pod "727e1989-a102-468c-af84-a86c761a4135" (UID: "727e1989-a102-468c-af84-a86c761a4135"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:31.135296 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.134870    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/727e1989-a102-468c-af84-a86c761a4135-tls-certs" pod "727e1989-a102-468c-af84-a86c761a4135" (UID: "727e1989-a102-468c-af84-a86c761a4135"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:31.135296 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.134887    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-dshm" pod "727e1989-a102-468c-af84-a86c761a4135" (UID: "727e1989-a102-468c-af84-a86c761a4135"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:31.135648 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.135611    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/727e1989-a102-468c-af84-a86c761a4135-kube-api-access-s72wk" pod "727e1989-a102-468c-af84-a86c761a4135" (UID: "727e1989-a102-468c-af84-a86c761a4135"). InnerVolumeSpecName "kube-api-access-s72wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:31.136098 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.135839    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f013308-5885-4d09-8947-6bbd783fba1b-tls-certs" pod "5f013308-5885-4d09-8947-6bbd783fba1b" (UID: "5f013308-5885-4d09-8947-6bbd783fba1b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:31.136098 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.135958    6048 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-home\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:31.136098 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.135992    6048 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-tmp-dir\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:31.136098 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.136006    6048 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-tmp-dir\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:31.136098 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.136050    6048 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-home\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:31.136098 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.136064    6048 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-model-cache\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:31.136098 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.136077    6048 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-model-cache\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:31.136708 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.136685    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-dshm" pod "5f013308-5885-4d09-8947-6bbd783fba1b" (UID: "5f013308-5885-4d09-8947-6bbd783fba1b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:31.137081 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.137058    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f013308-5885-4d09-8947-6bbd783fba1b-kube-api-access-rkslz" pod "5f013308-5885-4d09-8947-6bbd783fba1b" (UID: "5f013308-5885-4d09-8947-6bbd783fba1b"). InnerVolumeSpecName "kube-api-access-rkslz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:31.239897 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.239681    6048 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/727e1989-a102-468c-af84-a86c761a4135-dshm\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:31.239897 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.239727    6048 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f013308-5885-4d09-8947-6bbd783fba1b-tls-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:31.239897 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.239740    6048 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f013308-5885-4d09-8947-6bbd783fba1b-dshm\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:31.239897 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.239757    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s72wk\" (UniqueName: \"kubernetes.io/projected/727e1989-a102-468c-af84-a86c761a4135-kube-api-access-s72wk\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:31.239897 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.239771    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkslz\" (UniqueName: \"kubernetes.io/projected/5f013308-5885-4d09-8947-6bbd783fba1b-kube-api-access-rkslz\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:31.239897 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.239784    6048 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/727e1989-a102-468c-af84-a86c761a4135-tls-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:31.316154 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.316073    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a99f6390-6609-4125-bac3-2e347b8fa7bf" path="/var/lib/kubelet/pods/a99f6390-6609-4125-bac3-2e347b8fa7bf/volumes"
Oct 30 21:02:31.665047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.664639    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:02:31.665047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.664890    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Oct 30 21:02:31.898120 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.891999    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:02:31.898687 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.898649    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 21:02:31.901980 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.901958    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67" event={"ID":"5f013308-5885-4d09-8947-6bbd783fba1b","Type":"ContainerDied","Data":"d434a5db769c648dd760ab84eb02664e87f620c0ca1c366df64c6805251fad9b"}
Oct 30 21:02:31.902176 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.902154    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"
Oct 30 21:02:31.902265 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.902168    6048 scope.go:122] "RemoveContainer" containerID="932fae69af880a90763f428ed8770e68957310fa77f8ecffee1f69da2d7133a6"
Oct 30 21:02:31.904069 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.904044    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2" event={"ID":"727e1989-a102-468c-af84-a86c761a4135","Type":"ContainerDied","Data":"e2eda5a7855838c780aff16ea91df26192bcee1c8d808905010d934b05925920"}
Oct 30 21:02:31.904161 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.904114    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"
Oct 30 21:02:31.914932 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.914911    6048 scope.go:122] "RemoveContainer" containerID="6c8e0bb30d757a1cf88a0b0ccb0aafdd2438f59ab646b713a5819f365cdad763"
Oct 30 21:02:31.928072 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.928049    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"]
Oct 30 21:02:31.932233 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.932211    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/simulator-w0-4a0c5b-kserve-7d69fcc86d-p7nn2"]
Oct 30 21:02:31.940698 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.940672    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"]
Oct 30 21:02:31.980048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:31.969765    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-4a0c5b/distinct-2-w0-4a0c5b-kserve-59ddf66cc5-qcs67"]
Oct 30 21:02:32.637558 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:32.637518    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:02:32.637736 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:32.637580    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Oct 30 21:02:32.860514 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:32.860477    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:02:32.860796 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:32.860765    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 21:02:33.318845 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:33.314357    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" path="/var/lib/kubelet/pods/5f013308-5885-4d09-8947-6bbd783fba1b/volumes"
Oct 30 21:02:33.318845 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:33.315189    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="727e1989-a102-468c-af84-a86c761a4135" path="/var/lib/kubelet/pods/727e1989-a102-468c-af84-a86c761a4135/volumes"
Oct 30 21:02:33.393674 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:33.393638    6048 patch_prober.go:29] interesting pod/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:02:33.393941 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:33.393913    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" podUID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:02:33.637853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:33.637763    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:02:33.638124 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:33.638089    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Oct 30 21:02:33.858125 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:33.858091    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Oct 30 21:02:33.858330 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:33.858165    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Oct 30 21:02:34.011214 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:34.011056    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"]
Oct 30 21:02:34.037050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:34.036210    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"]
Oct 30 21:02:34.906130 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:34.906056    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl" podUID="b4893641-f5a3-44b3-823b-8a3c2d6fa548" containerName="payload-pre-processing" containerID="cri-o://840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e" gracePeriod=25
Oct 30 21:02:34.959273 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:34.932874    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w" podUID="ffcfe6ad-d38d-445d-8dd3-98be89d45ac9" containerName="payload-processing" containerID="cri-o://04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d" gracePeriod=25
Oct 30 21:02:34.971127 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:34.962873    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:02:34.990753 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:34.990701    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": dial tcp 10.134.0.97:15021: connect: connection refused"
Oct 30 21:02:35.960343 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:35.960313    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:35.962314 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:35.962279    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:36.200487 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:36.200120    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl" podUID="b4893641-f5a3-44b3-823b-8a3c2d6fa548" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:36.207042 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:36.200833    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w" podUID="ffcfe6ad-d38d-445d-8dd3-98be89d45ac9" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:36.772050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:36.727362    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:36.772050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:36.748520    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:36.772050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:36.748595    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:36.772050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:36.749215    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:36.817175 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:36.817125    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podUID="18730625-e6ba-421a-9a27-02acc29e9a2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.31:8000/ready\": context deadline exceeded"
Oct 30 21:02:37.087057 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.080177    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:37.087057 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.080259    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:37.087057 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.080326    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:37.087057 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.080389    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:37.113195 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.113136    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:37.185390 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.182908    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:37.244069 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.229376    6048 generic.go:356] "Generic (PLEG): container finished" podID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" containerID="4e4a21d19eca6ac961dcd3ad879c3d90a3900975bba9c22a8b2ba08d42f075bd" exitCode=0
Oct 30 21:02:37.244069 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.229554    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" event={"ID":"abe9083c-53e0-4ad9-a4b4-a0ab01695b61","Type":"ContainerDied","Data":"4e4a21d19eca6ac961dcd3ad879c3d90a3900975bba9c22a8b2ba08d42f075bd"}
Oct 30 21:02:37.749129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.737155    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded"
Oct 30 21:02:37.749129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.737825    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 21:02:37.749630 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.749553    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:37.761493 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.750230    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:02:37.761493 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.750230    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:37.761493 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:37.750437    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:38.117071 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.116867    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:02:38.130453 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.128732    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:02:38.141673 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.141464    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 21:02:38.148238 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.148176    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"]
Oct 30 21:02:38.148612 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.148575    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:02:38.149003 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.148956    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy" containerID="cri-o://7d8c02f265137243e3449a5bb330d7e4e5acc2ad2febdb8854370a3fb7c380d2" gracePeriod=30
Oct 30 21:02:38.155125 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.155075    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"]
Oct 30 21:02:38.163047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.155587    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms" podUID="ce7325fd-eccd-4b9e-b1ef-770f781db58b" containerName="istio-proxy" containerID="cri-o://fea89a71f361db242892132b43439b17f8680f3e92913a8c7d533f3dd33e020c" gracePeriod=30
Oct 30 21:02:38.179265 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.165955    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"]
Oct 30 21:02:38.179265 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.166934    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy" containerID="cri-o://911abf62d880413afacdd473541eb93d07bd7271aa29cebc498676b837e3bd1c" gracePeriod=30
Oct 30 21:02:38.245051 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.244109    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Oct 30 21:02:38.245051 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.244527    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 21:02:38.295094 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.245926    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:38.295094 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.245977    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:38.323865 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.323263    6048 patch_prober.go:29] interesting pod/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:02:38.323865 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.323353    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:02:38.336594 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.329369    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 21:02:38.404936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.384334    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:02:38.404936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.388289    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"]
Oct 30 21:02:38.404936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.388604    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy" containerID="cri-o://db23576516fd94510277a6e707cc79e607e8b6363395c87c4a347cefd4022d26" gracePeriod=30
Oct 30 21:02:38.485342 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.485286    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-kube-api-access-dssw4\" (UniqueName: \"kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-kube-api-access-dssw4\") pod \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") "
Oct 30 21:02:38.485699 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.485627    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-token\" (UniqueName: \"kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-token\") pod \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") "
Oct 30 21:02:38.485895 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.485874    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-credential-socket\") pod \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") "
Oct 30 21:02:38.486104 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.486085    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-certs\") pod \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") "
Oct 30 21:02:38.486474 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.486454    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-podinfo\") pod \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") "
Oct 30 21:02:38.486611 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.486594    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-envoy\") pod \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") "
Oct 30 21:02:38.486733 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.486717    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-socket\") pod \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") "
Oct 30 21:02:38.486839 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.486824    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istiod-ca-cert\") pod \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") "
Oct 30 21:02:38.486964 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.486949    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-data\") pod \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\" (UID: \"abe9083c-53e0-4ad9-a4b4-a0ab01695b61\") "
Oct 30 21:02:38.488930 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.488902    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-data" pod "abe9083c-53e0-4ad9-a4b4-a0ab01695b61" (UID: "abe9083c-53e0-4ad9-a4b4-a0ab01695b61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:38.520638 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.520594    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-credential-socket" pod "abe9083c-53e0-4ad9-a4b4-a0ab01695b61" (UID: "abe9083c-53e0-4ad9-a4b4-a0ab01695b61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:38.525329 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.525294    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-certs" pod "abe9083c-53e0-4ad9-a4b4-a0ab01695b61" (UID: "abe9083c-53e0-4ad9-a4b4-a0ab01695b61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:38.525734 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.525713    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-socket" pod "abe9083c-53e0-4ad9-a4b4-a0ab01695b61" (UID: "abe9083c-53e0-4ad9-a4b4-a0ab01695b61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:38.531800 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.530235    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istiod-ca-cert" pod "abe9083c-53e0-4ad9-a4b4-a0ab01695b61" (UID: "abe9083c-53e0-4ad9-a4b4-a0ab01695b61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:38.531800 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.531684    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-kube-api-access-dssw4" pod "abe9083c-53e0-4ad9-a4b4-a0ab01695b61" (UID: "abe9083c-53e0-4ad9-a4b4-a0ab01695b61"). InnerVolumeSpecName "kube-api-access-dssw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:38.531800 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.531751    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-token" pod "abe9083c-53e0-4ad9-a4b4-a0ab01695b61" (UID: "abe9083c-53e0-4ad9-a4b4-a0ab01695b61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:38.536363 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.536335    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-envoy" pod "abe9083c-53e0-4ad9-a4b4-a0ab01695b61" (UID: "abe9083c-53e0-4ad9-a4b4-a0ab01695b61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:38.557922 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.555501    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-podinfo" pod "abe9083c-53e0-4ad9-a4b4-a0ab01695b61" (UID: "abe9083c-53e0-4ad9-a4b4-a0ab01695b61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:38.557922 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.556881    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 21:02:38.574669 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.574626    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw" event={"ID":"abe9083c-53e0-4ad9-a4b4-a0ab01695b61","Type":"ContainerDied","Data":"15031153f6d352317599e09f20823bd05971648509784d41ae274ccb9250691e"}
Oct 30 21:02:38.578442 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.578415    6048 scope.go:122] "RemoveContainer" containerID="4e4a21d19eca6ac961dcd3ad879c3d90a3900975bba9c22a8b2ba08d42f075bd"
Oct 30 21:02:38.579609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.579194    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"
Oct 30 21:02:38.635709 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.635680    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:38.635901 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.635886    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:38.636046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.636016    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:38.636139 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.636127    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:38.636231 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.636220    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:38.636313 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.636301    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dssw4\" (UniqueName: \"kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-kube-api-access-dssw4\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:38.636390 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.636380    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:38.636474 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.636463    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:38.636552 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.636542    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe9083c-53e0-4ad9-a4b4-a0ab01695b61-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:38.813185 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.805506    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"]
Oct 30 21:02:38.813185 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.811446    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-39fb96-openshift-default-5f55489475-kt7cw"]
Oct 30 21:02:38.813185 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.812225    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:38.813185 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:38.812290    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:39.016055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:39.013690    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm" podUID="2e1a4e79-7954-407f-b9a7-fa5163bb099a" containerName="payload-processing" containerID="cri-o://e7c5ad01d5886da4a967611c861ffcec739688cfe25ee32a429d3e1d0eff36fe" gracePeriod=25
Oct 30 21:02:39.037999 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:39.036796    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm" podUID="bb223380-c1c3-4a02-8cc0-5021e8d258af" containerName="payload-pre-processing" containerID="cri-o://6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e" gracePeriod=25
Oct 30 21:02:39.248555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:39.248459    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:02:39.249147 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:39.249111    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:39.265413 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:39.265371    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" path="/var/lib/kubelet/pods/abe9083c-53e0-4ad9-a4b4-a0ab01695b61/volumes"
Oct 30 21:02:39.622388 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:39.622354    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:39.623486 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:39.623432    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:39.624704 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:39.624684    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:02:39.873973 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:39.872869    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" containerID="cri-o://ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36" gracePeriod=45
Oct 30 21:02:40.103892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.097902    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:40.103892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.099427    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:40.104161 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.104044    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:02:40.259225 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.259198    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 21:02:40.411440 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.411403    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tmp-dir\") pod \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") "
Oct 30 21:02:40.411617 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.411454    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eebd051e-6e84-4e36-9ae7-c14239aae8e3-kube-api-access-dw6cn\" (UniqueName: \"kubernetes.io/projected/eebd051e-6e84-4e36-9ae7-c14239aae8e3-kube-api-access-dw6cn\") pod \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") "
Oct 30 21:02:40.411617 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.411515    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-home\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-home\") pod \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") "
Oct 30 21:02:40.411748 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.411627    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tls-certs\" (UniqueName: \"kubernetes.io/secret/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tls-certs\") pod \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") "
Oct 30 21:02:40.411797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.411723    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tmp-dir" pod "eebd051e-6e84-4e36-9ae7-c14239aae8e3" (UID: "eebd051e-6e84-4e36-9ae7-c14239aae8e3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:40.411797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.411765    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-home" pod "eebd051e-6e84-4e36-9ae7-c14239aae8e3" (UID: "eebd051e-6e84-4e36-9ae7-c14239aae8e3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:40.411883 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.411795    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-model-cache\") pod \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") "
Oct 30 21:02:40.411883 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.411832    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-dshm\") pod \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\" (UID: \"eebd051e-6e84-4e36-9ae7-c14239aae8e3\") "
Oct 30 21:02:40.412139 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.412052    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-model-cache" pod "eebd051e-6e84-4e36-9ae7-c14239aae8e3" (UID: "eebd051e-6e84-4e36-9ae7-c14239aae8e3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:40.412901 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.412875    6048 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tmp-dir\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:40.412901 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.412904    6048 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-home\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:40.413101 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.412919    6048 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-model-cache\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:40.414235 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.414207    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-dshm" pod "eebd051e-6e84-4e36-9ae7-c14239aae8e3" (UID: "eebd051e-6e84-4e36-9ae7-c14239aae8e3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:40.414351 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.414245    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tls-certs" pod "eebd051e-6e84-4e36-9ae7-c14239aae8e3" (UID: "eebd051e-6e84-4e36-9ae7-c14239aae8e3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:40.414351 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.414303    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eebd051e-6e84-4e36-9ae7-c14239aae8e3-kube-api-access-dw6cn" pod "eebd051e-6e84-4e36-9ae7-c14239aae8e3" (UID: "eebd051e-6e84-4e36-9ae7-c14239aae8e3"). InnerVolumeSpecName "kube-api-access-dw6cn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:40.514664 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.514575    6048 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eebd051e-6e84-4e36-9ae7-c14239aae8e3-tls-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:40.514664 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.514618    6048 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eebd051e-6e84-4e36-9ae7-c14239aae8e3-dshm\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:40.514664 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.514634    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw6cn\" (UniqueName: \"kubernetes.io/projected/eebd051e-6e84-4e36-9ae7-c14239aae8e3-kube-api-access-dw6cn\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:40.530264 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.530228    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"]
Oct 30 21:02:40.530899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.530882    6048 cpu_manager.go:414] "containerMap: removing container" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main"
Oct 30 21:02:40.530899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.530898    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main"
Oct 30 21:02:40.531097 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.530932    6048 cpu_manager.go:414] "containerMap: removing container" podUID="1892700d-9b18-4189-81d9-d414b98ed7d9" containerName="revoke-keys"
Oct 30 21:02:40.531097 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.530937    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1892700d-9b18-4189-81d9-d414b98ed7d9" containerName="revoke-keys"
Oct 30 21:02:40.531097 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.530946    6048 cpu_manager.go:414] "containerMap: removing container" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main"
Oct 30 21:02:40.531097 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.530953    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main"
Oct 30 21:02:40.531097 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.530965    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a99f6390-6609-4125-bac3-2e347b8fa7bf" containerName="maas-api"
Oct 30 21:02:40.531097 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.530970    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a99f6390-6609-4125-bac3-2e347b8fa7bf" containerName="maas-api"
Oct 30 21:02:40.531097 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.530985    6048 cpu_manager.go:414] "containerMap: removing container" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main"
Oct 30 21:02:40.531097 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.530990    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main"
Oct 30 21:02:40.531097 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.531011    6048 cpu_manager.go:414] "containerMap: removing container" podUID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" containerName="istio-proxy"
Oct 30 21:02:40.531097 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.531017    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" containerName="istio-proxy"
Oct 30 21:02:40.531630 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.531155    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="abe9083c-53e0-4ad9-a4b4-a0ab01695b61" containerName="istio-proxy"
Oct 30 21:02:40.531630 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.531163    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="727e1989-a102-468c-af84-a86c761a4135" containerName="main"
Oct 30 21:02:40.531630 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.531174    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="1892700d-9b18-4189-81d9-d414b98ed7d9" containerName="revoke-keys"
Oct 30 21:02:40.531630 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.531180    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main"
Oct 30 21:02:40.531630 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.531188    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a99f6390-6609-4125-bac3-2e347b8fa7bf" containerName="maas-api"
Oct 30 21:02:40.531630 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.531195    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f013308-5885-4d09-8947-6bbd783fba1b" containerName="main"
Oct 30 21:02:40.534934 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.534912    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.547180 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.547141    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"]
Oct 30 21:02:40.613102 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.612960    6048 generic.go:356] "Generic (PLEG): container finished" podID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerID="ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36" exitCode=0
Oct 30 21:02:40.613525 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.613486    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" event={"ID":"eebd051e-6e84-4e36-9ae7-c14239aae8e3","Type":"ContainerDied","Data":"ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36"}
Oct 30 21:02:40.613720 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.613561    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" event={"ID":"eebd051e-6e84-4e36-9ae7-c14239aae8e3","Type":"ContainerDied","Data":"c787a7b0e55632c99be04f37514455e7a38353aeccd0bce5aca2b660bbf9e5dd"}
Oct 30 21:02:40.613720 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.613586    6048 scope.go:122] "RemoveContainer" containerID="ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36"
Oct 30 21:02:40.613860 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.613836    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"
Oct 30 21:02:40.615445 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.615414    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.615539 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.615464    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.615539 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.615530    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.615662 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.615589    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6ffx\" (UniqueName: \"kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-kube-api-access-v6ffx\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.615731 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.615702    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.615911 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.615884    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34e95215-8cbc-48d6-9cc6-06c01826d25f-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.615993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.615957    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.616155 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.616131    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.616233 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.616188    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.627178 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.627154    6048 scope.go:122] "RemoveContainer" containerID="ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36"
Oct 30 21:02:40.627524 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:02:40.627491    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36\": container with ID starting with ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36 not found: ID does not exist" containerID="ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36"
Oct 30 21:02:40.627619 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.627537    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36"} err="failed to get container status \"ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36\": rpc error: code = NotFound desc = could not find container \"ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36\": container with ID starting with ada9172147f7117831e1bab0f9c1220c358ee24bc4804870375da211d7599c36 not found: ID does not exist"
Oct 30 21:02:40.648772 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.648734    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"]
Oct 30 21:02:40.656580 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.656547    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb"]
Oct 30 21:02:40.728492 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.726862    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.728492 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.728072    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34e95215-8cbc-48d6-9cc6-06c01826d25f-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.728492 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.728268    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.728492 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.728335    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.728492 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.728424    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.728492 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.728464    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.728952 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.728516    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.728952 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.728618    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.728952 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.728664    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6ffx\" (UniqueName: \"kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-kube-api-access-v6ffx\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.729145 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.728985    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-credential-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.730088 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.730000    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-certs\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.730215 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.730088    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34e95215-8cbc-48d6-9cc6-06c01826d25f-istiod-ca-cert\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.730407 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.730381    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-socket\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.730670 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.730642    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-data\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.732705 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.732679    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-envoy\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.734547 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.734237    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-podinfo\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.746232 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.746206    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"]
Oct 30 21:02:40.746996 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.746976    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6ffx\" (UniqueName: \"kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-kube-api-access-v6ffx\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.749514 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.749489    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-token\") pod \"e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") " pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.751700 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.751682    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:40.757946 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.757926    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:02:40.758499 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.758479    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:02:40.760075 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.760051    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"]
Oct 30 21:02:40.830914 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.830868    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-xks-ca\") pod \"maas-api-revoke-sub-13122362-78shm\" (UID: \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:40.831233 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.831210    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf46n\" (UniqueName: \"kubernetes.io/projected/e65fd2ab-db13-4873-b1f1-75c03dbb0891-kube-api-access-rf46n\") pod \"maas-api-revoke-sub-13122362-78shm\" (UID: \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:40.831384 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.831353    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-13122362-78shm\" (UID: \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:40.870135 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.870106    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:40.934792 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.933640    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf46n\" (UniqueName: \"kubernetes.io/projected/e65fd2ab-db13-4873-b1f1-75c03dbb0891-kube-api-access-rf46n\") pod \"maas-api-revoke-sub-13122362-78shm\" (UID: \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:40.934792 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.933788    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-13122362-78shm\" (UID: \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:40.934792 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.933897    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-xks-ca\") pod \"maas-api-revoke-sub-13122362-78shm\" (UID: \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:40.937367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.935118    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-13122362-78shm\" (UID: \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:40.937367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.937327    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-xks-ca\") pod \"maas-api-revoke-sub-13122362-78shm\" (UID: \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:40.949749 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:40.949718    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf46n\" (UniqueName: \"kubernetes.io/projected/e65fd2ab-db13-4873-b1f1-75c03dbb0891-kube-api-access-rf46n\") pod \"maas-api-revoke-sub-13122362-78shm\" (UID: \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:41.073154 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.073122    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:41.174224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.174183    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-65968b/simulator-w5-65968b-kserve-55d44dd88-jbsbb" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:02:41.177627 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:02:41.177601    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e95215_8cbc_48d6_9cc6_06c01826d25f.slice/crio-a83809ff052450f187d8e2e6480f36baa7a4b0bc510f36e35316f1960f04bff6 WatchSource:0}: Error finding container a83809ff052450f187d8e2e6480f36baa7a4b0bc510f36e35316f1960f04bff6: Status 404 returned error can't find the container with id a83809ff052450f187d8e2e6480f36baa7a4b0bc510f36e35316f1960f04bff6
Oct 30 21:02:41.180780 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.180748    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:41.180876 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.180810    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:41.180876 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.180841    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:02:41.181344 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.181241    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"]
Oct 30 21:02:41.262883 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.262856    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eebd051e-6e84-4e36-9ae7-c14239aae8e3" path="/var/lib/kubelet/pods/eebd051e-6e84-4e36-9ae7-c14239aae8e3/volumes"
Oct 30 21:02:41.366360 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.366329    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"]
Oct 30 21:02:41.368825 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:02:41.368795    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65fd2ab_db13_4873_b1f1_75c03dbb0891.slice/crio-b0ff8ec2174ca15e016cc2e19bc92879b253efe00ce7ed2b33af643aaed8df9d WatchSource:0}: Error finding container b0ff8ec2174ca15e016cc2e19bc92879b253efe00ce7ed2b33af643aaed8df9d: Status 404 returned error can't find the container with id b0ff8ec2174ca15e016cc2e19bc92879b253efe00ce7ed2b33af643aaed8df9d
Oct 30 21:02:41.625158 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.625054    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" event={"ID":"34e95215-8cbc-48d6-9cc6-06c01826d25f","Type":"ContainerStarted","Data":"e1148d653c0d42af192fd1682f9ca46ee4ec8b664a0f476264c8132f9bb261d5"}
Oct 30 21:02:41.625158 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.625116    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" event={"ID":"34e95215-8cbc-48d6-9cc6-06c01826d25f","Type":"ContainerStarted","Data":"a83809ff052450f187d8e2e6480f36baa7a4b0bc510f36e35316f1960f04bff6"}
Oct 30 21:02:41.626525 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.626495    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm" event={"ID":"e65fd2ab-db13-4873-b1f1-75c03dbb0891","Type":"ContainerStarted","Data":"b0ff8ec2174ca15e016cc2e19bc92879b253efe00ce7ed2b33af643aaed8df9d"}
Oct 30 21:02:41.694083 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.690668    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" podStartSLOduration=1.690651653 podStartE2EDuration="1.690651653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:41.690318349 +0000 UTC m=+1372.549054654" watchObservedRunningTime="2026-10-30 21:02:41.690651653 +0000 UTC m=+1372.549387946"
Oct 30 21:02:41.871111 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:41.871078    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:42.635763 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:42.635676    6048 generic.go:356] "Generic (PLEG): container finished" podID="e65fd2ab-db13-4873-b1f1-75c03dbb0891" containerID="6ad3a3421260188a5ecb524df473e7ae1fff9dbcbbb907559738a6bc7b433ac3" exitCode=0
Oct 30 21:02:42.636160 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:42.635762    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm" event={"ID":"e65fd2ab-db13-4873-b1f1-75c03dbb0891","Type":"ContainerDied","Data":"6ad3a3421260188a5ecb524df473e7ae1fff9dbcbbb907559738a6bc7b433ac3"}
Oct 30 21:02:42.872034 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:42.871989    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:02:42.872191 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:42.872093    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" podUID="34e95215-8cbc-48d6-9cc6-06c01826d25f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused"
Oct 30 21:02:43.513047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.506542    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"]
Oct 30 21:02:43.586062 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.573322    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"]
Oct 30 21:02:43.586062 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.573485    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:43.633529 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.632861    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e28e7c9-bnnst\" (UID: \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:43.633529 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.633253    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e28e7c9-bnnst\" (UID: \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:43.633529 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.633291    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbbb2\" (UniqueName: \"kubernetes.io/projected/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-kube-api-access-gbbb2\") pod \"maas-api-revoke-sub-2e28e7c9-bnnst\" (UID: \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:43.635780 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.635081    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"]
Oct 30 21:02:43.692669 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.690332    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:43.693211 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.693124    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"]
Oct 30 21:02:43.711529 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.711322    6048 generic.go:356] "Generic (PLEG): container finished" podID="a13da80e-3191-468e-892f-db0a84b06b3c" containerID="911abf62d880413afacdd473541eb93d07bd7271aa29cebc498676b837e3bd1c" exitCode=0
Oct 30 21:02:43.711813 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.711721    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" event={"ID":"a13da80e-3191-468e-892f-db0a84b06b3c","Type":"ContainerDied","Data":"911abf62d880413afacdd473541eb93d07bd7271aa29cebc498676b837e3bd1c"}
Oct 30 21:02:43.738544 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.735917    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th7z7\" (UniqueName: \"kubernetes.io/projected/4008794a-54c1-42cb-b1b5-0b693853c487-kube-api-access-th7z7\") pod \"maas-api-revoke-sub-541c2d05-5nh5w\" (UID: \"4008794a-54c1-42cb-b1b5-0b693853c487\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:43.738544 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.736092    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-541c2d05-5nh5w\" (UID: \"4008794a-54c1-42cb-b1b5-0b693853c487\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:43.738544 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.736132    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-xks-ca\") pod \"maas-api-revoke-sub-541c2d05-5nh5w\" (UID: \"4008794a-54c1-42cb-b1b5-0b693853c487\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:43.738544 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.736184    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e28e7c9-bnnst\" (UID: \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:43.738544 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.736213    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbbb2\" (UniqueName: \"kubernetes.io/projected/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-kube-api-access-gbbb2\") pod \"maas-api-revoke-sub-2e28e7c9-bnnst\" (UID: \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:43.738544 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.736263    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e28e7c9-bnnst\" (UID: \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:43.738544 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.737817    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e28e7c9-bnnst\" (UID: \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:43.741338 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.740713    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e28e7c9-bnnst\" (UID: \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:43.823536 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.823510    6048 generic.go:356] "Generic (PLEG): container finished" podID="080b8378-c19b-4464-903c-a0e47a458775" containerID="db23576516fd94510277a6e707cc79e607e8b6363395c87c4a347cefd4022d26" exitCode=0
Oct 30 21:02:43.823818 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.823801    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" event={"ID":"080b8378-c19b-4464-903c-a0e47a458775","Type":"ContainerDied","Data":"db23576516fd94510277a6e707cc79e607e8b6363395c87c4a347cefd4022d26"}
Oct 30 21:02:43.823948 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.823937    6048 scope.go:122] "RemoveContainer" containerID="c0c2a0824e8a2803beb3e72da8258a74d05eacffd082c6228354e3fe522a6f10"
Oct 30 21:02:43.824792 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.824706    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbbb2\" (UniqueName: \"kubernetes.io/projected/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-kube-api-access-gbbb2\") pod \"maas-api-revoke-sub-2e28e7c9-bnnst\" (UID: \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:43.831253 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.830227    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:02:43.866348 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.843665    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" containerID="cri-o://0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe" gracePeriod=45
Oct 30 21:02:43.866348 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.843963    6048 generic.go:356] "Generic (PLEG): container finished" podID="ce7325fd-eccd-4b9e-b1ef-770f781db58b" containerID="fea89a71f361db242892132b43439b17f8680f3e92913a8c7d533f3dd33e020c" exitCode=0
Oct 30 21:02:43.866348 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.844101    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms" event={"ID":"ce7325fd-eccd-4b9e-b1ef-770f781db58b","Type":"ContainerDied","Data":"fea89a71f361db242892132b43439b17f8680f3e92913a8c7d533f3dd33e020c"}
Oct 30 21:02:43.866348 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.857136    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:43.902906 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.902870    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:02:43.903185 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.903150    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" podUID="34e95215-8cbc-48d6-9cc6-06c01826d25f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused"
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.903320    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-podinfo\") pod \"e7ba0657-f0de-4706-8917-56d3c9d53cad\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") "
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.903364    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-credential-socket\") pod \"e7ba0657-f0de-4706-8917-56d3c9d53cad\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") "
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.903388    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-data\") pod \"e7ba0657-f0de-4706-8917-56d3c9d53cad\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") "
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.903488    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-kube-api-access-qnkw2\" (UniqueName: \"kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-kube-api-access-qnkw2\") pod \"e7ba0657-f0de-4706-8917-56d3c9d53cad\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") "
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.903508    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-socket\") pod \"e7ba0657-f0de-4706-8917-56d3c9d53cad\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") "
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.903526    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-envoy\") pod \"e7ba0657-f0de-4706-8917-56d3c9d53cad\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") "
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.903751    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e7ba0657-f0de-4706-8917-56d3c9d53cad-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ba0657-f0de-4706-8917-56d3c9d53cad-istiod-ca-cert\") pod \"e7ba0657-f0de-4706-8917-56d3c9d53cad\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") "
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.903891    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-token\" (UniqueName: \"kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-token\") pod \"e7ba0657-f0de-4706-8917-56d3c9d53cad\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") "
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.903914    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-data" pod "e7ba0657-f0de-4706-8917-56d3c9d53cad" (UID: "e7ba0657-f0de-4706-8917-56d3c9d53cad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.903987    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-certs\") pod \"e7ba0657-f0de-4706-8917-56d3c9d53cad\" (UID: \"e7ba0657-f0de-4706-8917-56d3c9d53cad\") "
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.904386    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-541c2d05-5nh5w\" (UID: \"4008794a-54c1-42cb-b1b5-0b693853c487\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.904463    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-xks-ca\") pod \"maas-api-revoke-sub-541c2d05-5nh5w\" (UID: \"4008794a-54c1-42cb-b1b5-0b693853c487\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.904682    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-credential-socket" pod "e7ba0657-f0de-4706-8917-56d3c9d53cad" (UID: "e7ba0657-f0de-4706-8917-56d3c9d53cad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.904945    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-socket" pod "e7ba0657-f0de-4706-8917-56d3c9d53cad" (UID: "e7ba0657-f0de-4706-8917-56d3c9d53cad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.905106    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th7z7\" (UniqueName: \"kubernetes.io/projected/4008794a-54c1-42cb-b1b5-0b693853c487-kube-api-access-th7z7\") pod \"maas-api-revoke-sub-541c2d05-5nh5w\" (UID: \"4008794a-54c1-42cb-b1b5-0b693853c487\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.905297    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.905317    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.905701 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.905331    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:43.906705 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.906650    6048 generic.go:356] "Generic (PLEG): container finished" podID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerID="7d8c02f265137243e3449a5bb330d7e4e5acc2ad2febdb8854370a3fb7c380d2" exitCode=0
Oct 30 21:02:43.909125 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.907174    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"
Oct 30 21:02:43.909125 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.907541    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz" event={"ID":"e7ba0657-f0de-4706-8917-56d3c9d53cad","Type":"ContainerDied","Data":"7d8c02f265137243e3449a5bb330d7e4e5acc2ad2febdb8854370a3fb7c380d2"}
Oct 30 21:02:43.909125 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.908171    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-kube-api-access-qnkw2" pod "e7ba0657-f0de-4706-8917-56d3c9d53cad" (UID: "e7ba0657-f0de-4706-8917-56d3c9d53cad"). InnerVolumeSpecName "kube-api-access-qnkw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:43.909125 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.908705    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-541c2d05-5nh5w\" (UID: \"4008794a-54c1-42cb-b1b5-0b693853c487\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:43.909125 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.909066    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-certs" pod "e7ba0657-f0de-4706-8917-56d3c9d53cad" (UID: "e7ba0657-f0de-4706-8917-56d3c9d53cad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.910121 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.910077    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7ba0657-f0de-4706-8917-56d3c9d53cad-istiod-ca-cert" pod "e7ba0657-f0de-4706-8917-56d3c9d53cad" (UID: "e7ba0657-f0de-4706-8917-56d3c9d53cad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:43.924166 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.916554    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-xks-ca\") pod \"maas-api-revoke-sub-541c2d05-5nh5w\" (UID: \"4008794a-54c1-42cb-b1b5-0b693853c487\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:43.924166 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.916997    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-podinfo" pod "e7ba0657-f0de-4706-8917-56d3c9d53cad" (UID: "e7ba0657-f0de-4706-8917-56d3c9d53cad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:43.924166 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.918866    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-token" pod "e7ba0657-f0de-4706-8917-56d3c9d53cad" (UID: "e7ba0657-f0de-4706-8917-56d3c9d53cad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:43.932695 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.930980    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th7z7\" (UniqueName: \"kubernetes.io/projected/4008794a-54c1-42cb-b1b5-0b693853c487-kube-api-access-th7z7\") pod \"maas-api-revoke-sub-541c2d05-5nh5w\" (UID: \"4008794a-54c1-42cb-b1b5-0b693853c487\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:43.933599 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.933078    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-envoy" pod "e7ba0657-f0de-4706-8917-56d3c9d53cad" (UID: "e7ba0657-f0de-4706-8917-56d3c9d53cad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:43.933734 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.933594    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main" containerID="cri-o://021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2" gracePeriod=45
Oct 30 21:02:43.958364 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:43.957765    6048 scope.go:122] "RemoveContainer" containerID="7d8c02f265137243e3449a5bb330d7e4e5acc2ad2febdb8854370a3fb7c380d2"
Oct 30 21:02:44.010450 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.010416    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.010570 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.010452    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnkw2\" (UniqueName: \"kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-kube-api-access-qnkw2\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.010570 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.010468    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.010570 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.010482    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7ba0657-f0de-4706-8917-56d3c9d53cad-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.010570 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.010496    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7ba0657-f0de-4706-8917-56d3c9d53cad-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.010570 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.010509    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7ba0657-f0de-4706-8917-56d3c9d53cad-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.066567 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.060618    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main" probeResult="failure" output="Get \"https://10.134.0.75:8000/ready\": dial tcp 10.134.0.75:8000: connect: connection refused"
Oct 30 21:02:44.105580 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.105550    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:02:44.108951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.108921    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:02:44.140292 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.136321    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:44.197233 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.197199    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 21:02:44.307384 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.307315    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"]
Oct 30 21:02:44.312271 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.312206    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-t2psz"]
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.320620    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a13da80e-3191-468e-892f-db0a84b06b3c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a13da80e-3191-468e-892f-db0a84b06b3c-istio-podinfo\") pod \"a13da80e-3191-468e-892f-db0a84b06b3c\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.320687    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-certs\") pod \"080b8378-c19b-4464-903c-a0e47a458775\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.320730    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-credential-socket\") pod \"080b8378-c19b-4464-903c-a0e47a458775\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.320759    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-kube-api-access-vd9hm\" (UniqueName: \"kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-kube-api-access-vd9hm\") pod \"a13da80e-3191-468e-892f-db0a84b06b3c\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.320803    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-data\") pod \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.320844    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-credential-socket\") pod \"a13da80e-3191-468e-892f-db0a84b06b3c\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.320889    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-socket\") pod \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.320924    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-envoy\") pod \"080b8378-c19b-4464-903c-a0e47a458775\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321036    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/080b8378-c19b-4464-903c-a0e47a458775-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/080b8378-c19b-4464-903c-a0e47a458775-istio-podinfo\") pod \"080b8378-c19b-4464-903c-a0e47a458775\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321068    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-token\" (UniqueName: \"kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-token\") pod \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321105    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/080b8378-c19b-4464-903c-a0e47a458775-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/080b8378-c19b-4464-903c-a0e47a458775-istiod-ca-cert\") pod \"080b8378-c19b-4464-903c-a0e47a458775\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321131    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-istio-token\" (UniqueName: \"kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-istio-token\") pod \"080b8378-c19b-4464-903c-a0e47a458775\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321161    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-certs\") pod \"a13da80e-3191-468e-892f-db0a84b06b3c\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321195    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-socket\") pod \"080b8378-c19b-4464-903c-a0e47a458775\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321232    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-data\") pod \"a13da80e-3191-468e-892f-db0a84b06b3c\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321267    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-data\") pod \"080b8378-c19b-4464-903c-a0e47a458775\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321311    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-credential-socket\") pod \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321383    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-envoy\") pod \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321430    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-certs\") pod \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321475    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-kube-api-access-mdpcf\" (UniqueName: \"kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-kube-api-access-mdpcf\") pod \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321533    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-envoy\") pod \"a13da80e-3191-468e-892f-db0a84b06b3c\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321608    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istiod-ca-cert\") pod \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321643    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a13da80e-3191-468e-892f-db0a84b06b3c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a13da80e-3191-468e-892f-db0a84b06b3c-istiod-ca-cert\") pod \"a13da80e-3191-468e-892f-db0a84b06b3c\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321691    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-istio-token\" (UniqueName: \"kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-istio-token\") pod \"a13da80e-3191-468e-892f-db0a84b06b3c\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321768    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-kube-api-access-tstkj\" (UniqueName: \"kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-kube-api-access-tstkj\") pod \"080b8378-c19b-4464-903c-a0e47a458775\" (UID: \"080b8378-c19b-4464-903c-a0e47a458775\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321805    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-podinfo\") pod \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\" (UID: \"ce7325fd-eccd-4b9e-b1ef-770f781db58b\") "
Oct 30 21:02:44.322794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.321839    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-socket\") pod \"a13da80e-3191-468e-892f-db0a84b06b3c\" (UID: \"a13da80e-3191-468e-892f-db0a84b06b3c\") "
Oct 30 21:02:44.324850 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.324493    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-socket" pod "a13da80e-3191-468e-892f-db0a84b06b3c" (UID: "a13da80e-3191-468e-892f-db0a84b06b3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.325800 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.325563    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a13da80e-3191-468e-892f-db0a84b06b3c-istiod-ca-cert" pod "a13da80e-3191-468e-892f-db0a84b06b3c" (UID: "a13da80e-3191-468e-892f-db0a84b06b3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:44.327155 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.326981    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-socket" pod "ce7325fd-eccd-4b9e-b1ef-770f781db58b" (UID: "ce7325fd-eccd-4b9e-b1ef-770f781db58b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.327450 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.327293    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-certs" pod "080b8378-c19b-4464-903c-a0e47a458775" (UID: "080b8378-c19b-4464-903c-a0e47a458775"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.327843 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.327565    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-credential-socket" pod "080b8378-c19b-4464-903c-a0e47a458775" (UID: "080b8378-c19b-4464-903c-a0e47a458775"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.328190 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.328170    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-socket" pod "080b8378-c19b-4464-903c-a0e47a458775" (UID: "080b8378-c19b-4464-903c-a0e47a458775"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.328477 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.328461    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-certs" pod "a13da80e-3191-468e-892f-db0a84b06b3c" (UID: "a13da80e-3191-468e-892f-db0a84b06b3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.337230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.336521    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-data" pod "a13da80e-3191-468e-892f-db0a84b06b3c" (UID: "a13da80e-3191-468e-892f-db0a84b06b3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.337230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.336681    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-data" pod "ce7325fd-eccd-4b9e-b1ef-770f781db58b" (UID: "ce7325fd-eccd-4b9e-b1ef-770f781db58b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.337230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.336602    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istiod-ca-cert" pod "ce7325fd-eccd-4b9e-b1ef-770f781db58b" (UID: "ce7325fd-eccd-4b9e-b1ef-770f781db58b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:44.337230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.336708    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-data" pod "080b8378-c19b-4464-903c-a0e47a458775" (UID: "080b8378-c19b-4464-903c-a0e47a458775"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.337230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.336899    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-credential-socket" pod "a13da80e-3191-468e-892f-db0a84b06b3c" (UID: "a13da80e-3191-468e-892f-db0a84b06b3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.337230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.336903    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-credential-socket" pod "ce7325fd-eccd-4b9e-b1ef-770f781db58b" (UID: "ce7325fd-eccd-4b9e-b1ef-770f781db58b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.337639 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.337263    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/080b8378-c19b-4464-903c-a0e47a458775-istiod-ca-cert" pod "080b8378-c19b-4464-903c-a0e47a458775" (UID: "080b8378-c19b-4464-903c-a0e47a458775"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:44.340586 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.340551    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-certs" pod "ce7325fd-eccd-4b9e-b1ef-770f781db58b" (UID: "ce7325fd-eccd-4b9e-b1ef-770f781db58b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.373582 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.370832    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-kube-api-access-vd9hm" pod "a13da80e-3191-468e-892f-db0a84b06b3c" (UID: "a13da80e-3191-468e-892f-db0a84b06b3c"). InnerVolumeSpecName "kube-api-access-vd9hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:44.373582 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.373471    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-envoy" pod "080b8378-c19b-4464-903c-a0e47a458775" (UID: "080b8378-c19b-4464-903c-a0e47a458775"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.373867 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.373842    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-istio-token" pod "a13da80e-3191-468e-892f-db0a84b06b3c" (UID: "a13da80e-3191-468e-892f-db0a84b06b3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:44.373952 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.373935    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-podinfo" pod "ce7325fd-eccd-4b9e-b1ef-770f781db58b" (UID: "ce7325fd-eccd-4b9e-b1ef-770f781db58b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:44.375763 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.375735    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-envoy" pod "ce7325fd-eccd-4b9e-b1ef-770f781db58b" (UID: "ce7325fd-eccd-4b9e-b1ef-770f781db58b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.378654 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.376235    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/080b8378-c19b-4464-903c-a0e47a458775-istio-podinfo" pod "080b8378-c19b-4464-903c-a0e47a458775" (UID: "080b8378-c19b-4464-903c-a0e47a458775"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:44.378654 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.378555    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-envoy" pod "a13da80e-3191-468e-892f-db0a84b06b3c" (UID: "a13da80e-3191-468e-892f-db0a84b06b3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.382418 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.379002    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-kube-api-access-mdpcf" pod "ce7325fd-eccd-4b9e-b1ef-770f781db58b" (UID: "ce7325fd-eccd-4b9e-b1ef-770f781db58b"). InnerVolumeSpecName "kube-api-access-mdpcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:44.382418 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.379173    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a13da80e-3191-468e-892f-db0a84b06b3c-istio-podinfo" pod "a13da80e-3191-468e-892f-db0a84b06b3c" (UID: "a13da80e-3191-468e-892f-db0a84b06b3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:02:44.382418 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.380379    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-kube-api-access-tstkj" pod "080b8378-c19b-4464-903c-a0e47a458775" (UID: "080b8378-c19b-4464-903c-a0e47a458775"). InnerVolumeSpecName "kube-api-access-tstkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:44.382418 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.380410    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-istio-token" pod "080b8378-c19b-4464-903c-a0e47a458775" (UID: "080b8378-c19b-4464-903c-a0e47a458775"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:44.382418 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.380574    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-token" pod "ce7325fd-eccd-4b9e-b1ef-770f781db58b" (UID: "ce7325fd-eccd-4b9e-b1ef-770f781db58b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:44.382418 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.381244    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:44.428068 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.427994    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e65fd2ab-db13-4873-b1f1-75c03dbb0891-kube-api-access-rf46n\" (UniqueName: \"kubernetes.io/projected/e65fd2ab-db13-4873-b1f1-75c03dbb0891-kube-api-access-rf46n\") pod \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\" (UID: \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\") "
Oct 30 21:02:44.428370 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.428108    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-xks-ca\") pod \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\" (UID: \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\") "
Oct 30 21:02:44.428370 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.428300    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-openshift-ca\") pod \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\" (UID: \"e65fd2ab-db13-4873-b1f1-75c03dbb0891\") "
Oct 30 21:02:44.428968 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.428941    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.428971    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.428988    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdpcf\" (UniqueName: \"kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-kube-api-access-mdpcf\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429002    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429016    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429057    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a13da80e-3191-468e-892f-db0a84b06b3c-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429075    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429089    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tstkj\" (UniqueName: \"kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-kube-api-access-tstkj\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429104    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429119    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429132    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a13da80e-3191-468e-892f-db0a84b06b3c-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429145    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429159    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429173    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd9hm\" (UniqueName: \"kubernetes.io/projected/a13da80e-3191-468e-892f-db0a84b06b3c-kube-api-access-vd9hm\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429190    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429202    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429217    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429230    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429245    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/080b8378-c19b-4464-903c-a0e47a458775-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429259    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7325fd-eccd-4b9e-b1ef-770f781db58b-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429273    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/080b8378-c19b-4464-903c-a0e47a458775-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429287    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/080b8378-c19b-4464-903c-a0e47a458775-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429301    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429316    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429329    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a13da80e-3191-468e-892f-db0a84b06b3c-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429344    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/080b8378-c19b-4464-903c-a0e47a458775-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.429510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429358    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7325fd-eccd-4b9e-b1ef-770f781db58b-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.430378 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.429712    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-openshift-ca" pod "e65fd2ab-db13-4873-b1f1-75c03dbb0891" (UID: "e65fd2ab-db13-4873-b1f1-75c03dbb0891"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:44.482655 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.482595    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-xks-ca" pod "e65fd2ab-db13-4873-b1f1-75c03dbb0891" (UID: "e65fd2ab-db13-4873-b1f1-75c03dbb0891"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:44.484878 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.484844    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e65fd2ab-db13-4873-b1f1-75c03dbb0891-kube-api-access-rf46n" pod "e65fd2ab-db13-4873-b1f1-75c03dbb0891" (UID: "e65fd2ab-db13-4873-b1f1-75c03dbb0891"). InnerVolumeSpecName "kube-api-access-rf46n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:44.511379 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.506193    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:02:44.511379 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.507334    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"]
Oct 30 21:02:44.515789 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.515765    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 21:02:44.531826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.531188    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-model-cache\") pod \"c0dadee7-bff2-46b1-bcda-3d3153699577\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") "
Oct 30 21:02:44.531826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.531236    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-home\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-home\") pod \"97c16fe5-4533-4461-b707-875be418fce3\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") "
Oct 30 21:02:44.531826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.531280    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-home\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-home\") pod \"c0dadee7-bff2-46b1-bcda-3d3153699577\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") "
Oct 30 21:02:44.531826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.531419    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-tmp-dir\") pod \"c0dadee7-bff2-46b1-bcda-3d3153699577\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") "
Oct 30 21:02:44.531826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.531447    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c0dadee7-bff2-46b1-bcda-3d3153699577-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0dadee7-bff2-46b1-bcda-3d3153699577-tls-certs\") pod \"c0dadee7-bff2-46b1-bcda-3d3153699577\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") "
Oct 30 21:02:44.531826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.531494    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-model-cache\") pod \"97c16fe5-4533-4461-b707-875be418fce3\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") "
Oct 30 21:02:44.531826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.531602    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-dshm\") pod \"c0dadee7-bff2-46b1-bcda-3d3153699577\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") "
Oct 30 21:02:44.531826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.531692    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-dshm\") pod \"97c16fe5-4533-4461-b707-875be418fce3\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") "
Oct 30 21:02:44.531826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.531744    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97c16fe5-4533-4461-b707-875be418fce3-tls-certs\" (UniqueName: \"kubernetes.io/secret/97c16fe5-4533-4461-b707-875be418fce3-tls-certs\") pod \"97c16fe5-4533-4461-b707-875be418fce3\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") "
Oct 30 21:02:44.532508 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.531843    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0dadee7-bff2-46b1-bcda-3d3153699577-kube-api-access-h5njq\" (UniqueName: \"kubernetes.io/projected/c0dadee7-bff2-46b1-bcda-3d3153699577-kube-api-access-h5njq\") pod \"c0dadee7-bff2-46b1-bcda-3d3153699577\" (UID: \"c0dadee7-bff2-46b1-bcda-3d3153699577\") "
Oct 30 21:02:44.532508 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.531887    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/97c16fe5-4533-4461-b707-875be418fce3-kube-api-access-5jxzw\" (UniqueName: \"kubernetes.io/projected/97c16fe5-4533-4461-b707-875be418fce3-kube-api-access-5jxzw\") pod \"97c16fe5-4533-4461-b707-875be418fce3\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") "
Oct 30 21:02:44.532508 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.531918    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-tmp-dir\") pod \"97c16fe5-4533-4461-b707-875be418fce3\" (UID: \"97c16fe5-4533-4461-b707-875be418fce3\") "
Oct 30 21:02:44.532673 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.532507    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-home" pod "c0dadee7-bff2-46b1-bcda-3d3153699577" (UID: "c0dadee7-bff2-46b1-bcda-3d3153699577"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.532738 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.532703    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-model-cache" pod "c0dadee7-bff2-46b1-bcda-3d3153699577" (UID: "c0dadee7-bff2-46b1-bcda-3d3153699577"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.534044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.533999    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-tmp-dir" pod "c0dadee7-bff2-46b1-bcda-3d3153699577" (UID: "c0dadee7-bff2-46b1-bcda-3d3153699577"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.535571 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.535540    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-model-cache" pod "97c16fe5-4533-4461-b707-875be418fce3" (UID: "97c16fe5-4533-4461-b707-875be418fce3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.535839 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.535817    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-home" pod "97c16fe5-4533-4461-b707-875be418fce3" (UID: "97c16fe5-4533-4461-b707-875be418fce3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.536197 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.536174    6048 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-model-cache\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.536297 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.536203    6048 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-home\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.536297 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.536217    6048 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-home\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.536297 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.536230    6048 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-tmp-dir\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.536297 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.536245    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf46n\" (UniqueName: \"kubernetes.io/projected/e65fd2ab-db13-4873-b1f1-75c03dbb0891-kube-api-access-rf46n\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.536297 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.536261    6048 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-model-cache\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.536297 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.536275    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.536297 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.536290    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e65fd2ab-db13-4873-b1f1-75c03dbb0891-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.536658 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.536380    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-tmp-dir" pod "97c16fe5-4533-4461-b707-875be418fce3" (UID: "97c16fe5-4533-4461-b707-875be418fce3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.578794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.578636    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0dadee7-bff2-46b1-bcda-3d3153699577-tls-certs" pod "c0dadee7-bff2-46b1-bcda-3d3153699577" (UID: "c0dadee7-bff2-46b1-bcda-3d3153699577"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:44.579498 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.579455    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c16fe5-4533-4461-b707-875be418fce3-kube-api-access-5jxzw" pod "97c16fe5-4533-4461-b707-875be418fce3" (UID: "97c16fe5-4533-4461-b707-875be418fce3"). InnerVolumeSpecName "kube-api-access-5jxzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:44.579498 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.579490    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0dadee7-bff2-46b1-bcda-3d3153699577-kube-api-access-h5njq" pod "c0dadee7-bff2-46b1-bcda-3d3153699577" (UID: "c0dadee7-bff2-46b1-bcda-3d3153699577"). InnerVolumeSpecName "kube-api-access-h5njq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:44.579668 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.579523    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-dshm" pod "c0dadee7-bff2-46b1-bcda-3d3153699577" (UID: "c0dadee7-bff2-46b1-bcda-3d3153699577"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.580172 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.579949    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97c16fe5-4533-4461-b707-875be418fce3-tls-certs" pod "97c16fe5-4533-4461-b707-875be418fce3" (UID: "97c16fe5-4533-4461-b707-875be418fce3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:44.581266 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.581238    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-dshm" pod "97c16fe5-4533-4461-b707-875be418fce3" (UID: "97c16fe5-4533-4461-b707-875be418fce3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:02:44.637421 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.637385    6048 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0dadee7-bff2-46b1-bcda-3d3153699577-tls-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.637421 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.637416    6048 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0dadee7-bff2-46b1-bcda-3d3153699577-dshm\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.637421 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.637429    6048 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-dshm\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.637992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.637442    6048 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97c16fe5-4533-4461-b707-875be418fce3-tls-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.637992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.637453    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5njq\" (UniqueName: \"kubernetes.io/projected/c0dadee7-bff2-46b1-bcda-3d3153699577-kube-api-access-h5njq\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.637992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.637462    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jxzw\" (UniqueName: \"kubernetes.io/projected/97c16fe5-4533-4461-b707-875be418fce3-kube-api-access-5jxzw\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.637992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.637472    6048 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97c16fe5-4533-4461-b707-875be418fce3-tmp-dir\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:44.799181 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.799147    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"]
Oct 30 21:02:44.875045 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.874467    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:02:44.875045 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.874540    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" podUID="34e95215-8cbc-48d6-9cc6-06c01826d25f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused"
Oct 30 21:02:44.916219 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.916189    6048 generic.go:356] "Generic (PLEG): container finished" podID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerID="0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe" exitCode=0
Oct 30 21:02:44.916366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.916273    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" event={"ID":"c0dadee7-bff2-46b1-bcda-3d3153699577","Type":"ContainerDied","Data":"0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe"}
Oct 30 21:02:44.916366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.916310    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"
Oct 30 21:02:44.916366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.916331    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw" event={"ID":"c0dadee7-bff2-46b1-bcda-3d3153699577","Type":"ContainerDied","Data":"5140265c4e81b5206ad5918f2ca4f1e5b1f8e0fd5cd249af99e4fcfacb80a87a"}
Oct 30 21:02:44.916366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.916356    6048 scope.go:122] "RemoveContainer" containerID="0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe"
Oct 30 21:02:44.918096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.917954    6048 generic.go:356] "Generic (PLEG): container finished" podID="97c16fe5-4533-4461-b707-875be418fce3" containerID="021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2" exitCode=0
Oct 30 21:02:44.918096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.918042    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"
Oct 30 21:02:44.918096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.918056    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" event={"ID":"97c16fe5-4533-4461-b707-875be418fce3","Type":"ContainerDied","Data":"021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2"}
Oct 30 21:02:44.918274 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.918120    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths" event={"ID":"97c16fe5-4533-4461-b707-875be418fce3","Type":"ContainerDied","Data":"03a1570914c3ddcf2dec01fc2378dc9fbe1b17d3dfc47a4def55923731ad9b42"}
Oct 30 21:02:44.923089 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.922464    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"
Oct 30 21:02:44.923089 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.922521    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6" event={"ID":"080b8378-c19b-4464-903c-a0e47a458775","Type":"ContainerDied","Data":"4a728b473b68998a6f01bb09420988fa1bf2a6706d2abe7b0e983fe269d30f4f"}
Oct 30 21:02:44.929210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.927045    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"
Oct 30 21:02:44.929210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.927079    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms" event={"ID":"ce7325fd-eccd-4b9e-b1ef-770f781db58b","Type":"ContainerDied","Data":"076fb64d71f13e0203b4df0c2b06687ae6c6d7572f72f7b58dbed439de6a5ffe"}
Oct 30 21:02:44.932176 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.932156    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w" event={"ID":"4008794a-54c1-42cb-b1b5-0b693853c487","Type":"ContainerStarted","Data":"ceb060deeacf1309f0420542a89a31830c7b36ebab0735320f0978e60dd5ba86"}
Oct 30 21:02:44.933969 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.933953    6048 scope.go:122] "RemoveContainer" containerID="0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe"
Oct 30 21:02:44.934211 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.934189    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm" event={"ID":"e65fd2ab-db13-4873-b1f1-75c03dbb0891","Type":"ContainerDied","Data":"b0ff8ec2174ca15e016cc2e19bc92879b253efe00ce7ed2b33af643aaed8df9d"}
Oct 30 21:02:44.934338 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.934234    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0ff8ec2174ca15e016cc2e19bc92879b253efe00ce7ed2b33af643aaed8df9d"
Oct 30 21:02:44.934338 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.934295    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"
Oct 30 21:02:44.934617 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:02:44.934592    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe\": container with ID starting with 0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe not found: ID does not exist" containerID="0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe"
Oct 30 21:02:44.934699 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.934628    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe"} err="failed to get container status \"0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe\": rpc error: code = NotFound desc = could not find container \"0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe\": container with ID starting with 0291682ad7a694f760544c8fb72b97e2ac09b22da0aa31cbf502a5fff39a83fe not found: ID does not exist"
Oct 30 21:02:44.934699 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.934650    6048 scope.go:122] "RemoveContainer" containerID="021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2"
Oct 30 21:02:44.935944 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.935905    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst" event={"ID":"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac","Type":"ContainerStarted","Data":"05d4519b37c9df5b19f654059a689e1fdb943f89fa3d3dedb1ec6750420fa90f"}
Oct 30 21:02:44.937705 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.937682    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q" event={"ID":"a13da80e-3191-468e-892f-db0a84b06b3c","Type":"ContainerDied","Data":"6fef65953a6c39f6f93364994116428b3c27ae75d9bf0f10eaca132bb7e59a18"}
Oct 30 21:02:44.937797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.937765    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"
Oct 30 21:02:44.987126 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.987090    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"]
Oct 30 21:02:44.988876 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.988714    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/distinct-w4-c2d1eb-kserve-c874cdf48-62hdw"]
Oct 30 21:02:44.993380 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.993366    6048 scope.go:122] "RemoveContainer" containerID="021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2"
Oct 30 21:02:44.993853 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:02:44.993834    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2\": container with ID starting with 021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2 not found: ID does not exist" containerID="021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2"
Oct 30 21:02:44.993931 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.993862    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2"} err="failed to get container status \"021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2\": rpc error: code = NotFound desc = could not find container \"021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2\": container with ID starting with 021b9fde339af266974b52547f3970126ddb80b370d40d7cd617850e50e1aca2 not found: ID does not exist"
Oct 30 21:02:44.993931 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:44.993883    6048 scope.go:122] "RemoveContainer" containerID="db23576516fd94510277a6e707cc79e607e8b6363395c87c4a347cefd4022d26"
Oct 30 21:02:45.007334 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.007310    6048 scope.go:122] "RemoveContainer" containerID="fea89a71f361db242892132b43439b17f8680f3e92913a8c7d533f3dd33e020c"
Oct 30 21:02:45.007423 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.007410    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"]
Oct 30 21:02:45.011574 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.011549    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-c2d1eb/simulator-w4-c2d1eb-kserve-bf9d5b77b-88ths"]
Oct 30 21:02:45.023319 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.023289    6048 scope.go:122] "RemoveContainer" containerID="911abf62d880413afacdd473541eb93d07bd7271aa29cebc498676b837e3bd1c"
Oct 30 21:02:45.025256 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.025237    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"]
Oct 30 21:02:45.033164 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.033142    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-cfbq6"]
Oct 30 21:02:45.073095 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.073055    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"]
Oct 30 21:02:45.076938 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.076917    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-hcqms"]
Oct 30 21:02:45.090774 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.090715    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"]
Oct 30 21:02:45.099238 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.099213    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-32a969-openshift-default-8945d87fc-fl77q"]
Oct 30 21:02:45.279936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.279908    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="080b8378-c19b-4464-903c-a0e47a458775" path="/var/lib/kubelet/pods/080b8378-c19b-4464-903c-a0e47a458775/volumes"
Oct 30 21:02:45.280608 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.280589    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="97c16fe5-4533-4461-b707-875be418fce3" path="/var/lib/kubelet/pods/97c16fe5-4533-4461-b707-875be418fce3/volumes"
Oct 30 21:02:45.281091 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.281076    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" path="/var/lib/kubelet/pods/a13da80e-3191-468e-892f-db0a84b06b3c/volumes"
Oct 30 21:02:45.281804 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.281788    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" path="/var/lib/kubelet/pods/c0dadee7-bff2-46b1-bcda-3d3153699577/volumes"
Oct 30 21:02:45.282243 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.282226    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce7325fd-eccd-4b9e-b1ef-770f781db58b" path="/var/lib/kubelet/pods/ce7325fd-eccd-4b9e-b1ef-770f781db58b/volumes"
Oct 30 21:02:45.282644 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.282631    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" path="/var/lib/kubelet/pods/e7ba0657-f0de-4706-8917-56d3c9d53cad/volumes"
Oct 30 21:02:45.873423 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.873355    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:02:45.873889 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.873509    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" podUID="34e95215-8cbc-48d6-9cc6-06c01826d25f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused"
Oct 30 21:02:45.981868 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.981837    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w" event={"ID":"4008794a-54c1-42cb-b1b5-0b693853c487","Type":"ContainerStarted","Data":"5444dc3ecec3080f52e15320f438f6ab5d56182ee22a886ae462b3650ac728b6"}
Oct 30 21:02:45.983464 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.983442    6048 generic.go:356] "Generic (PLEG): container finished" podID="c59ef562-dd6a-4eae-bdb3-0f5657cd22ac" containerID="e5e7d619837b2a8590d172c750ac31fd2c05eaa130cdd9610302b94af3c9b500" exitCode=0
Oct 30 21:02:45.983561 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:45.983511    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst" event={"ID":"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac","Type":"ContainerDied","Data":"e5e7d619837b2a8590d172c750ac31fd2c05eaa130cdd9610302b94af3c9b500"}
Oct 30 21:02:46.124116 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:46.124083    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w" podUID="ffcfe6ad-d38d-445d-8dd3-98be89d45ac9" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:46.124275 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:46.124110    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl" podUID="b4893641-f5a3-44b3-823b-8a3c2d6fa548" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:46.803572 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:02:46.803531    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:02:46.870628 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:46.870581    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:02:46.870829 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:46.870645    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" podUID="34e95215-8cbc-48d6-9cc6-06c01826d25f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused"
Oct 30 21:02:46.995696 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:46.995658    6048 generic.go:356] "Generic (PLEG): container finished" podID="4008794a-54c1-42cb-b1b5-0b693853c487" containerID="5444dc3ecec3080f52e15320f438f6ab5d56182ee22a886ae462b3650ac728b6" exitCode=0
Oct 30 21:02:46.996213 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:46.995871    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w" event={"ID":"4008794a-54c1-42cb-b1b5-0b693853c487","Type":"ContainerDied","Data":"5444dc3ecec3080f52e15320f438f6ab5d56182ee22a886ae462b3650ac728b6"}
Oct 30 21:02:47.130223 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.130177    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm" podUID="2e1a4e79-7954-407f-b9a7-fa5163bb099a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:47.303292 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.303265    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:47.307167 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.307148    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:47.405530 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.404011    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4008794a-54c1-42cb-b1b5-0b693853c487-kube-api-access-th7z7\" (UniqueName: \"kubernetes.io/projected/4008794a-54c1-42cb-b1b5-0b693853c487-kube-api-access-th7z7\") pod \"4008794a-54c1-42cb-b1b5-0b693853c487\" (UID: \"4008794a-54c1-42cb-b1b5-0b693853c487\") "
Oct 30 21:02:47.405786 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.405762    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-openshift-ca\") pod \"4008794a-54c1-42cb-b1b5-0b693853c487\" (UID: \"4008794a-54c1-42cb-b1b5-0b693853c487\") "
Oct 30 21:02:47.405876 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.405857    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-openshift-ca\") pod \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\" (UID: \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\") "
Oct 30 21:02:47.405937 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.405900    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-xks-ca\") pod \"4008794a-54c1-42cb-b1b5-0b693853c487\" (UID: \"4008794a-54c1-42cb-b1b5-0b693853c487\") "
Oct 30 21:02:47.406052 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.406035    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-kube-api-access-gbbb2\" (UniqueName: \"kubernetes.io/projected/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-kube-api-access-gbbb2\") pod \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\" (UID: \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\") "
Oct 30 21:02:47.406122 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.406086    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-xks-ca\") pod \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\" (UID: \"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac\") "
Oct 30 21:02:47.406375 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.406341    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-openshift-ca" pod "4008794a-54c1-42cb-b1b5-0b693853c487" (UID: "4008794a-54c1-42cb-b1b5-0b693853c487"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:47.406699 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.406680    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.407379 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.407349    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-openshift-ca" pod "c59ef562-dd6a-4eae-bdb3-0f5657cd22ac" (UID: "c59ef562-dd6a-4eae-bdb3-0f5657cd22ac"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:47.408275 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.408241    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4008794a-54c1-42cb-b1b5-0b693853c487-kube-api-access-th7z7" pod "4008794a-54c1-42cb-b1b5-0b693853c487" (UID: "4008794a-54c1-42cb-b1b5-0b693853c487"). InnerVolumeSpecName "kube-api-access-th7z7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:47.412501 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.412470    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-kube-api-access-gbbb2" pod "c59ef562-dd6a-4eae-bdb3-0f5657cd22ac" (UID: "c59ef562-dd6a-4eae-bdb3-0f5657cd22ac"). InnerVolumeSpecName "kube-api-access-gbbb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:47.412581 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.412502    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-xks-ca" pod "c59ef562-dd6a-4eae-bdb3-0f5657cd22ac" (UID: "c59ef562-dd6a-4eae-bdb3-0f5657cd22ac"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:47.412581 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.412562    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-xks-ca" pod "4008794a-54c1-42cb-b1b5-0b693853c487" (UID: "4008794a-54c1-42cb-b1b5-0b693853c487"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:47.508635 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.508589    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th7z7\" (UniqueName: \"kubernetes.io/projected/4008794a-54c1-42cb-b1b5-0b693853c487-kube-api-access-th7z7\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.508635 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.508637    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.508872 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.508654    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4008794a-54c1-42cb-b1b5-0b693853c487-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.508872 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.508671    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbbb2\" (UniqueName: \"kubernetes.io/projected/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-kube-api-access-gbbb2\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.508872 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.508686    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:47.871178 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.871114    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:02:47.871373 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:47.871250    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" podUID="34e95215-8cbc-48d6-9cc6-06c01826d25f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.98:15021/healthz/ready\": dial tcp 10.134.0.98:15021: connect: connection refused"
Oct 30 21:02:48.004609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:48.004572    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"
Oct 30 21:02:48.005094 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:48.004562    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w" event={"ID":"4008794a-54c1-42cb-b1b5-0b693853c487","Type":"ContainerDied","Data":"ceb060deeacf1309f0420542a89a31830c7b36ebab0735320f0978e60dd5ba86"}
Oct 30 21:02:48.005094 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:48.004741    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ceb060deeacf1309f0420542a89a31830c7b36ebab0735320f0978e60dd5ba86"
Oct 30 21:02:48.006172 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:48.006142    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"
Oct 30 21:02:48.006281 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:48.006182    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst" event={"ID":"c59ef562-dd6a-4eae-bdb3-0f5657cd22ac","Type":"ContainerDied","Data":"05d4519b37c9df5b19f654059a689e1fdb943f89fa3d3dedb1ec6750420fa90f"}
Oct 30 21:02:48.006281 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:48.006240    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05d4519b37c9df5b19f654059a689e1fdb943f89fa3d3dedb1ec6750420fa90f"
Oct 30 21:02:48.136033 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:48.135913    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm" podUID="bb223380-c1c3-4a02-8cc0-5021e8d258af" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:48.920793 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:48.920758    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:48.921284 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:48.921245    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:48.922480 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:48.922456    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:02:54.840698 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:54.840657    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"]
Oct 30 21:02:54.841212 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:54.840894    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerName="istio-proxy" containerID="cri-o://18323d1f8dc84cf9ae4ef9d616932003124eaa96c399b621c3a6705a60981090" gracePeriod=30
Oct 30 21:02:54.847319 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:54.847290    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"]
Oct 30 21:02:54.847536 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:54.847513    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" podUID="7de72904-4846-4ae7-baa4-07e587cb6199" containerName="istio-proxy" containerID="cri-o://53a01d98cb1e23c27c144ff0dc61efa59aa8756a6cbba8c926c37507294e5f4a" gracePeriod=30
Oct 30 21:02:54.852192 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:54.852164    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"]
Oct 30 21:02:54.852388 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:54.852365    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy" containerID="cri-o://344e3e1bd012486d27a13924bc94f464010ad54efc7edc8c595b3a4fbdbbb4e4" gracePeriod=30
Oct 30 21:02:55.321267 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.321237    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"
Oct 30 21:02:55.363494 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.363459    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b4893641-f5a3-44b3-823b-8a3c2d6fa548-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4893641-f5a3-44b3-823b-8a3c2d6fa548-plugins-config-volume\") pod \"b4893641-f5a3-44b3-823b-8a3c2d6fa548\" (UID: \"b4893641-f5a3-44b3-823b-8a3c2d6fa548\") "
Oct 30 21:02:55.363679 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.363662    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4893641-f5a3-44b3-823b-8a3c2d6fa548-kube-api-access-c88mk\" (UniqueName: \"kubernetes.io/projected/b4893641-f5a3-44b3-823b-8a3c2d6fa548-kube-api-access-c88mk\") pod \"b4893641-f5a3-44b3-823b-8a3c2d6fa548\" (UID: \"b4893641-f5a3-44b3-823b-8a3c2d6fa548\") "
Oct 30 21:02:55.364192 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.364157    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4893641-f5a3-44b3-823b-8a3c2d6fa548-plugins-config-volume" pod "b4893641-f5a3-44b3-823b-8a3c2d6fa548" (UID: "b4893641-f5a3-44b3-823b-8a3c2d6fa548"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:55.366058 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.366018    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4893641-f5a3-44b3-823b-8a3c2d6fa548-kube-api-access-c88mk" pod "b4893641-f5a3-44b3-823b-8a3c2d6fa548" (UID: "b4893641-f5a3-44b3-823b-8a3c2d6fa548"). InnerVolumeSpecName "kube-api-access-c88mk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:55.372688 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.372665    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"
Oct 30 21:02:55.465276 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.465241    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-plugins-config-volume\") pod \"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9\" (UID: \"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9\") "
Oct 30 21:02:55.465451 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.465421    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-kube-api-access-jqf8d\" (UniqueName: \"kubernetes.io/projected/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-kube-api-access-jqf8d\") pod \"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9\" (UID: \"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9\") "
Oct 30 21:02:55.465614 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.465589    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-plugins-config-volume" pod "ffcfe6ad-d38d-445d-8dd3-98be89d45ac9" (UID: "ffcfe6ad-d38d-445d-8dd3-98be89d45ac9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:55.465904 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.465889    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c88mk\" (UniqueName: \"kubernetes.io/projected/b4893641-f5a3-44b3-823b-8a3c2d6fa548-kube-api-access-c88mk\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.465949 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.465907    6048 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-plugins-config-volume\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.465949 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.465918    6048 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4893641-f5a3-44b3-823b-8a3c2d6fa548-plugins-config-volume\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.467705 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.467679    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-kube-api-access-jqf8d" pod "ffcfe6ad-d38d-445d-8dd3-98be89d45ac9" (UID: "ffcfe6ad-d38d-445d-8dd3-98be89d45ac9"). InnerVolumeSpecName "kube-api-access-jqf8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:55.567268 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.567229    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqf8d\" (UniqueName: \"kubernetes.io/projected/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9-kube-api-access-jqf8d\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:55.697070 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.696967    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"]
Oct 30 21:02:55.697268 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:55.697218    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4" podUID="ea40cb7a-b1a7-480d-99b8-88c825bc3448" containerName="maas-api" containerID="cri-o://0b9d7c801b35b64be968e521e7b0b5884fdca5ba568317d66834776a12339ff7" gracePeriod=30
Oct 30 21:02:56.125726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.096215    6048 generic.go:356] "Generic (PLEG): container finished" podID="b4893641-f5a3-44b3-823b-8a3c2d6fa548" containerID="840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e" exitCode=0
Oct 30 21:02:56.125726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.096267    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"
Oct 30 21:02:56.125726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.096318    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl" event={"ID":"b4893641-f5a3-44b3-823b-8a3c2d6fa548","Type":"ContainerDied","Data":"840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e"}
Oct 30 21:02:56.125726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.096361    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl" event={"ID":"b4893641-f5a3-44b3-823b-8a3c2d6fa548","Type":"ContainerDied","Data":"46e8822009629bf92ed1a5d3b5ac4af0266c529908b96d008edf7b1de0ee545e"}
Oct 30 21:02:56.125726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.096390    6048 scope.go:122] "RemoveContainer" containerID="840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e"
Oct 30 21:02:56.125726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.102973    6048 generic.go:356] "Generic (PLEG): container finished" podID="ffcfe6ad-d38d-445d-8dd3-98be89d45ac9" containerID="04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d" exitCode=0
Oct 30 21:02:56.125726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.103200    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w" event={"ID":"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9","Type":"ContainerDied","Data":"04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d"}
Oct 30 21:02:56.125726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.103248    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w" event={"ID":"ffcfe6ad-d38d-445d-8dd3-98be89d45ac9","Type":"ContainerDied","Data":"720c18ae3799218b335282b40b11007b80da73f63f3f8936f9bff51751583650"}
Oct 30 21:02:56.125726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.103337    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"
Oct 30 21:02:56.125726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.108912    6048 generic.go:356] "Generic (PLEG): container finished" podID="ea40cb7a-b1a7-480d-99b8-88c825bc3448" containerID="0b9d7c801b35b64be968e521e7b0b5884fdca5ba568317d66834776a12339ff7" exitCode=0
Oct 30 21:02:56.125726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.108975    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4" event={"ID":"ea40cb7a-b1a7-480d-99b8-88c825bc3448","Type":"ContainerDied","Data":"0b9d7c801b35b64be968e521e7b0b5884fdca5ba568317d66834776a12339ff7"}
Oct 30 21:02:56.127173 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.126966    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 21:02:56.130822 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.130781    6048 scope.go:122] "RemoveContainer" containerID="840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e"
Oct 30 21:02:56.131269 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:02:56.131236    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e\": container with ID starting with 840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e not found: ID does not exist" containerID="840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e"
Oct 30 21:02:56.131369 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.131286    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e"} err="failed to get container status \"840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e\": rpc error: code = NotFound desc = could not find container \"840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e\": container with ID starting with 840fdd74c2557fb12b55a0400ff783755cebbc1513ff0ccc82a28667c664ab3e not found: ID does not exist"
Oct 30 21:02:56.131369 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.131313    6048 scope.go:122] "RemoveContainer" containerID="04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d"
Oct 30 21:02:56.141769 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.141747    6048 scope.go:122] "RemoveContainer" containerID="04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d"
Oct 30 21:02:56.142094 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:02:56.142068    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d\": container with ID starting with 04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d not found: ID does not exist" containerID="04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d"
Oct 30 21:02:56.142171 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.142103    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d"} err="failed to get container status \"04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d\": rpc error: code = NotFound desc = could not find container \"04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d\": container with ID starting with 04592ccb05646068f0c6c7c5932c3337d73de6a08f8e4ced7600ea6b179ff50d not found: ID does not exist"
Oct 30 21:02:56.153143 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.153113    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"]
Oct 30 21:02:56.162146 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.162114    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-5a8f94-656b4b7cb6-ptf5w"]
Oct 30 21:02:56.173127 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.173097    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"]
Oct 30 21:02:56.186776 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.186747    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea40cb7a-b1a7-480d-99b8-88c825bc3448-kube-api-access-t5mrn\" (UniqueName: \"kubernetes.io/projected/ea40cb7a-b1a7-480d-99b8-88c825bc3448-kube-api-access-t5mrn\") pod \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") "
Oct 30 21:02:56.186944 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.186893    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ea40cb7a-b1a7-480d-99b8-88c825bc3448-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea40cb7a-b1a7-480d-99b8-88c825bc3448-openshift-service-ca\") pod \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") "
Oct 30 21:02:56.186944 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.186937    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-metrics-certs\") pod \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") "
Oct 30 21:02:56.187121 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.187011    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-maas-api-tls\") pod \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\" (UID: \"ea40cb7a-b1a7-480d-99b8-88c825bc3448\") "
Oct 30 21:02:56.187680 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.187652    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea40cb7a-b1a7-480d-99b8-88c825bc3448-openshift-service-ca" pod "ea40cb7a-b1a7-480d-99b8-88c825bc3448" (UID: "ea40cb7a-b1a7-480d-99b8-88c825bc3448"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:56.189564 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.189534    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-maas-api-tls" pod "ea40cb7a-b1a7-480d-99b8-88c825bc3448" (UID: "ea40cb7a-b1a7-480d-99b8-88c825bc3448"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:56.189668 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.189646    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-metrics-certs" pod "ea40cb7a-b1a7-480d-99b8-88c825bc3448" (UID: "ea40cb7a-b1a7-480d-99b8-88c825bc3448"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:56.189827 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.189804    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea40cb7a-b1a7-480d-99b8-88c825bc3448-kube-api-access-t5mrn" pod "ea40cb7a-b1a7-480d-99b8-88c825bc3448" (UID: "ea40cb7a-b1a7-480d-99b8-88c825bc3448"). InnerVolumeSpecName "kube-api-access-t5mrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:56.189979 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.189963    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-5a8f94-547f9f4fb7-tz9kl"]
Oct 30 21:02:56.288871 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.288835    6048 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea40cb7a-b1a7-480d-99b8-88c825bc3448-openshift-service-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:56.288871 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.288867    6048 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-metrics-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:56.288871 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.288879    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea40cb7a-b1a7-480d-99b8-88c825bc3448-maas-api-tls\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:56.288871 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:56.288888    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5mrn\" (UniqueName: \"kubernetes.io/projected/ea40cb7a-b1a7-480d-99b8-88c825bc3448-kube-api-access-t5mrn\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:57.117985 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:57.117956    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"
Oct 30 21:02:57.118217 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:57.117952    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4" event={"ID":"ea40cb7a-b1a7-480d-99b8-88c825bc3448","Type":"ContainerDied","Data":"9a2462fd765848a11dbcf68b050bbbeef10b9c9e38fe4804aa92507774555815"}
Oct 30 21:02:57.118217 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:57.118093    6048 scope.go:122] "RemoveContainer" containerID="0b9d7c801b35b64be968e521e7b0b5884fdca5ba568317d66834776a12339ff7"
Oct 30 21:02:57.129219 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:57.129194    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm" podUID="2e1a4e79-7954-407f-b9a7-fa5163bb099a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:57.147843 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:57.147810    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"]
Oct 30 21:02:57.154990 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:57.154961    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-c2d1eb-7466bc7f68-2pqx4"]
Oct 30 21:02:57.259576 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:57.259538    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b4893641-f5a3-44b3-823b-8a3c2d6fa548" path="/var/lib/kubelet/pods/b4893641-f5a3-44b3-823b-8a3c2d6fa548/volumes"
Oct 30 21:02:57.260016 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:57.260001    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea40cb7a-b1a7-480d-99b8-88c825bc3448" path="/var/lib/kubelet/pods/ea40cb7a-b1a7-480d-99b8-88c825bc3448/volumes"
Oct 30 21:02:57.260420 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:57.260406    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ffcfe6ad-d38d-445d-8dd3-98be89d45ac9" path="/var/lib/kubelet/pods/ffcfe6ad-d38d-445d-8dd3-98be89d45ac9/volumes"
Oct 30 21:02:58.137483 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:58.134780    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm" podUID="bb223380-c1c3-4a02-8cc0-5021e8d258af" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:02:59.136697 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.136663    6048 generic.go:356] "Generic (PLEG): container finished" podID="2e1a4e79-7954-407f-b9a7-fa5163bb099a" containerID="e7c5ad01d5886da4a967611c861ffcec739688cfe25ee32a429d3e1d0eff36fe" exitCode=0
Oct 30 21:02:59.136841 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.136736    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm" event={"ID":"2e1a4e79-7954-407f-b9a7-fa5163bb099a","Type":"ContainerDied","Data":"e7c5ad01d5886da4a967611c861ffcec739688cfe25ee32a429d3e1d0eff36fe"}
Oct 30 21:02:59.322619 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.322589    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"
Oct 30 21:02:59.357463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.357430    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"
Oct 30 21:02:59.430204 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.430175    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e1a4e79-7954-407f-b9a7-fa5163bb099a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e1a4e79-7954-407f-b9a7-fa5163bb099a-plugins-config-volume\") pod \"2e1a4e79-7954-407f-b9a7-fa5163bb099a\" (UID: \"2e1a4e79-7954-407f-b9a7-fa5163bb099a\") "
Oct 30 21:02:59.430357 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.430311    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb223380-c1c3-4a02-8cc0-5021e8d258af-kube-api-access-qksxp\" (UniqueName: \"kubernetes.io/projected/bb223380-c1c3-4a02-8cc0-5021e8d258af-kube-api-access-qksxp\") pod \"bb223380-c1c3-4a02-8cc0-5021e8d258af\" (UID: \"bb223380-c1c3-4a02-8cc0-5021e8d258af\") "
Oct 30 21:02:59.430436 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.430414    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb223380-c1c3-4a02-8cc0-5021e8d258af-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb223380-c1c3-4a02-8cc0-5021e8d258af-plugins-config-volume\") pod \"bb223380-c1c3-4a02-8cc0-5021e8d258af\" (UID: \"bb223380-c1c3-4a02-8cc0-5021e8d258af\") "
Oct 30 21:02:59.430507 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.430486    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e1a4e79-7954-407f-b9a7-fa5163bb099a-kube-api-access-8lmcc\" (UniqueName: \"kubernetes.io/projected/2e1a4e79-7954-407f-b9a7-fa5163bb099a-kube-api-access-8lmcc\") pod \"2e1a4e79-7954-407f-b9a7-fa5163bb099a\" (UID: \"2e1a4e79-7954-407f-b9a7-fa5163bb099a\") "
Oct 30 21:02:59.430640 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.430610    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1a4e79-7954-407f-b9a7-fa5163bb099a-plugins-config-volume" pod "2e1a4e79-7954-407f-b9a7-fa5163bb099a" (UID: "2e1a4e79-7954-407f-b9a7-fa5163bb099a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:59.431217 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.431172    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb223380-c1c3-4a02-8cc0-5021e8d258af-plugins-config-volume" pod "bb223380-c1c3-4a02-8cc0-5021e8d258af" (UID: "bb223380-c1c3-4a02-8cc0-5021e8d258af"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:59.431329 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.431280    6048 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e1a4e79-7954-407f-b9a7-fa5163bb099a-plugins-config-volume\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:59.432602 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.432583    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb223380-c1c3-4a02-8cc0-5021e8d258af-kube-api-access-qksxp" pod "bb223380-c1c3-4a02-8cc0-5021e8d258af" (UID: "bb223380-c1c3-4a02-8cc0-5021e8d258af"). InnerVolumeSpecName "kube-api-access-qksxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:59.432745 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.432728    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1a4e79-7954-407f-b9a7-fa5163bb099a-kube-api-access-8lmcc" pod "2e1a4e79-7954-407f-b9a7-fa5163bb099a" (UID: "2e1a4e79-7954-407f-b9a7-fa5163bb099a"). InnerVolumeSpecName "kube-api-access-8lmcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:59.532655 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.532621    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qksxp\" (UniqueName: \"kubernetes.io/projected/bb223380-c1c3-4a02-8cc0-5021e8d258af-kube-api-access-qksxp\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:59.532655 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.532649    6048 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb223380-c1c3-4a02-8cc0-5021e8d258af-plugins-config-volume\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:02:59.532655 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:02:59.532658    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lmcc\" (UniqueName: \"kubernetes.io/projected/2e1a4e79-7954-407f-b9a7-fa5163bb099a-kube-api-access-8lmcc\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.163065 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.151197    6048 generic.go:356] "Generic (PLEG): container finished" podID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerID="344e3e1bd012486d27a13924bc94f464010ad54efc7edc8c595b3a4fbdbbb4e4" exitCode=0
Oct 30 21:03:00.163065 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.151252    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" event={"ID":"82c15701-2c8e-4ec6-909b-e6cb642b42f4","Type":"ContainerDied","Data":"344e3e1bd012486d27a13924bc94f464010ad54efc7edc8c595b3a4fbdbbb4e4"}
Oct 30 21:03:00.163065 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.153274    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm" event={"ID":"2e1a4e79-7954-407f-b9a7-fa5163bb099a","Type":"ContainerDied","Data":"6cb7d17dad6ef31f1e1d863a8b4c9c0937f89631e4cd5e4fd8efd4a7b21975e8"}
Oct 30 21:03:00.163065 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.153330    6048 scope.go:122] "RemoveContainer" containerID="e7c5ad01d5886da4a967611c861ffcec739688cfe25ee32a429d3e1d0eff36fe"
Oct 30 21:03:00.163065 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.153457    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"
Oct 30 21:03:00.163774 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.163179    6048 generic.go:356] "Generic (PLEG): container finished" podID="bb223380-c1c3-4a02-8cc0-5021e8d258af" containerID="6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e" exitCode=0
Oct 30 21:03:00.163774 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.163320    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm" event={"ID":"bb223380-c1c3-4a02-8cc0-5021e8d258af","Type":"ContainerDied","Data":"6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e"}
Oct 30 21:03:00.163774 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.163362    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm" event={"ID":"bb223380-c1c3-4a02-8cc0-5021e8d258af","Type":"ContainerDied","Data":"f9daf6a3fe34d089bf3956f466c3701bf98936d7f455892fe3ba6c51b576cf21"}
Oct 30 21:03:00.163774 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.163441    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"
Oct 30 21:03:00.177189 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.177144    6048 generic.go:356] "Generic (PLEG): container finished" podID="7de72904-4846-4ae7-baa4-07e587cb6199" containerID="53a01d98cb1e23c27c144ff0dc61efa59aa8756a6cbba8c926c37507294e5f4a" exitCode=0
Oct 30 21:03:00.177331 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.177228    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" event={"ID":"7de72904-4846-4ae7-baa4-07e587cb6199","Type":"ContainerDied","Data":"53a01d98cb1e23c27c144ff0dc61efa59aa8756a6cbba8c926c37507294e5f4a"}
Oct 30 21:03:00.178828 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.178803    6048 generic.go:356] "Generic (PLEG): container finished" podID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerID="18323d1f8dc84cf9ae4ef9d616932003124eaa96c399b621c3a6705a60981090" exitCode=0
Oct 30 21:03:00.179339 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.178832    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" event={"ID":"9703dc85-1cd0-44c8-881a-1a84c54961ad","Type":"ContainerDied","Data":"18323d1f8dc84cf9ae4ef9d616932003124eaa96c399b621c3a6705a60981090"}
Oct 30 21:03:00.179339 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.178882    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf" event={"ID":"9703dc85-1cd0-44c8-881a-1a84c54961ad","Type":"ContainerDied","Data":"181ded720d05ff23291ecfd4046a7092578e4b8f0b75b6ab26c923ecbfebca9f"}
Oct 30 21:03:00.179339 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.178906    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="181ded720d05ff23291ecfd4046a7092578e4b8f0b75b6ab26c923ecbfebca9f"
Oct 30 21:03:00.181499 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.181483    6048 scope.go:122] "RemoveContainer" containerID="6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e"
Oct 30 21:03:00.181996 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.181979    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 21:03:00.202685 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.202658    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"]
Oct 30 21:03:00.202970 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.202955    6048 scope.go:122] "RemoveContainer" containerID="6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e"
Oct 30 21:03:00.203285 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:03:00.203264    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e\": container with ID starting with 6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e not found: ID does not exist" containerID="6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e"
Oct 30 21:03:00.203376 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.203294    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e"} err="failed to get container status \"6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e\": rpc error: code = NotFound desc = could not find container \"6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e\": container with ID starting with 6b65255b949a0c1ee6f7e0f3761cba744597801a56fd48b03749e024cc28ac9e not found: ID does not exist"
Oct 30 21:03:00.206690 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.206670    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-c2d1eb-7cf497b9d8-mhrfm"]
Oct 30 21:03:00.219616 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.219580    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"]
Oct 30 21:03:00.231582 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.231556    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c2d1eb-69f768886c-w59pm"]
Oct 30 21:03:00.233171 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.233154    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:03:00.235288 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.235271    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:03:00.349906 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.349864    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-socket\") pod \"9703dc85-1cd0-44c8-881a-1a84c54961ad\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") "
Oct 30 21:03:00.350414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.349924    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-kube-api-access-c8cn8\" (UniqueName: \"kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-kube-api-access-c8cn8\") pod \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") "
Oct 30 21:03:00.350414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.349957    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-podinfo\") pod \"9703dc85-1cd0-44c8-881a-1a84c54961ad\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") "
Oct 30 21:03:00.350414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.349992    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-token\" (UniqueName: \"kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-token\") pod \"9703dc85-1cd0-44c8-881a-1a84c54961ad\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") "
Oct 30 21:03:00.350414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.350061    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9703dc85-1cd0-44c8-881a-1a84c54961ad-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9703dc85-1cd0-44c8-881a-1a84c54961ad-istiod-ca-cert\") pod \"9703dc85-1cd0-44c8-881a-1a84c54961ad\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") "
Oct 30 21:03:00.350414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.350116    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7de72904-4846-4ae7-baa4-07e587cb6199-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7de72904-4846-4ae7-baa4-07e587cb6199-istio-podinfo\") pod \"7de72904-4846-4ae7-baa4-07e587cb6199\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") "
Oct 30 21:03:00.350414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.350185    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-data\") pod \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") "
Oct 30 21:03:00.350414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.350183    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-socket" pod "9703dc85-1cd0-44c8-881a-1a84c54961ad" (UID: "9703dc85-1cd0-44c8-881a-1a84c54961ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.350765 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.350537    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-data" pod "82c15701-2c8e-4ec6-909b-e6cb642b42f4" (UID: "82c15701-2c8e-4ec6-909b-e6cb642b42f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.350765 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.350541    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-envoy\") pod \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") "
Oct 30 21:03:00.350765 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.350660    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-envoy\") pod \"7de72904-4846-4ae7-baa4-07e587cb6199\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") "
Oct 30 21:03:00.350993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.350970    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-credential-socket\") pod \"9703dc85-1cd0-44c8-881a-1a84c54961ad\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") "
Oct 30 21:03:00.351138 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351098    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-credential-socket" pod "9703dc85-1cd0-44c8-881a-1a84c54961ad" (UID: "9703dc85-1cd0-44c8-881a-1a84c54961ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.351230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351144    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-kube-api-access-h7pkn\" (UniqueName: \"kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-kube-api-access-h7pkn\") pod \"9703dc85-1cd0-44c8-881a-1a84c54961ad\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") "
Oct 30 21:03:00.351486 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351463    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istiod-ca-cert\") pod \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") "
Oct 30 21:03:00.351575 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351543    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-certs\") pod \"7de72904-4846-4ae7-baa4-07e587cb6199\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") "
Oct 30 21:03:00.351641 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351574    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-data\") pod \"7de72904-4846-4ae7-baa4-07e587cb6199\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") "
Oct 30 21:03:00.351641 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351602    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-socket\") pod \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") "
Oct 30 21:03:00.351829 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351695    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-data\") pod \"9703dc85-1cd0-44c8-881a-1a84c54961ad\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") "
Oct 30 21:03:00.351829 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351743    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-certs\") pod \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") "
Oct 30 21:03:00.351829 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351782    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-credential-socket\") pod \"7de72904-4846-4ae7-baa4-07e587cb6199\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") "
Oct 30 21:03:00.351829 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351818    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7de72904-4846-4ae7-baa4-07e587cb6199-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7de72904-4846-4ae7-baa4-07e587cb6199-istiod-ca-cert\") pod \"7de72904-4846-4ae7-baa4-07e587cb6199\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") "
Oct 30 21:03:00.351829 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351818    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istiod-ca-cert" pod "82c15701-2c8e-4ec6-909b-e6cb642b42f4" (UID: "82c15701-2c8e-4ec6-909b-e6cb642b42f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:00.352210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351864    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-certs\") pod \"9703dc85-1cd0-44c8-881a-1a84c54961ad\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") "
Oct 30 21:03:00.352210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351930    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-credential-socket\") pod \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") "
Oct 30 21:03:00.352210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.351983    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-token\" (UniqueName: \"kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-token\") pod \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") "
Oct 30 21:03:00.352210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.352092    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-data" pod "7de72904-4846-4ae7-baa4-07e587cb6199" (UID: "7de72904-4846-4ae7-baa4-07e587cb6199"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.352210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.352096    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-envoy\") pod \"9703dc85-1cd0-44c8-881a-1a84c54961ad\" (UID: \"9703dc85-1cd0-44c8-881a-1a84c54961ad\") "
Oct 30 21:03:00.352210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.352106    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-certs" pod "82c15701-2c8e-4ec6-909b-e6cb642b42f4" (UID: "82c15701-2c8e-4ec6-909b-e6cb642b42f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.352210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.352150    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-socket\") pod \"7de72904-4846-4ae7-baa4-07e587cb6199\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") "
Oct 30 21:03:00.352210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.352184    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-podinfo\") pod \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\" (UID: \"82c15701-2c8e-4ec6-909b-e6cb642b42f4\") "
Oct 30 21:03:00.352688 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.352237    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-kube-api-access-p8kw2\" (UniqueName: \"kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-kube-api-access-p8kw2\") pod \"7de72904-4846-4ae7-baa4-07e587cb6199\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") "
Oct 30 21:03:00.352688 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.352304    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-istio-token\" (UniqueName: \"kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-istio-token\") pod \"7de72904-4846-4ae7-baa4-07e587cb6199\" (UID: \"7de72904-4846-4ae7-baa4-07e587cb6199\") "
Oct 30 21:03:00.352688 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.352367    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-certs" pod "7de72904-4846-4ae7-baa4-07e587cb6199" (UID: "7de72904-4846-4ae7-baa4-07e587cb6199"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.352688 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.352429    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-socket" pod "82c15701-2c8e-4ec6-909b-e6cb642b42f4" (UID: "82c15701-2c8e-4ec6-909b-e6cb642b42f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.352688 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.352594    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-data" pod "9703dc85-1cd0-44c8-881a-1a84c54961ad" (UID: "9703dc85-1cd0-44c8-881a-1a84c54961ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.353224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.353072    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.353224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.353099    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.353224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.353116    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.353224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.353130    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.353224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.353146    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.353224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.353159    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.353224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.353174    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.353224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.353190    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.353224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.353292    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-credential-socket" pod "7de72904-4846-4ae7-baa4-07e587cb6199" (UID: "7de72904-4846-4ae7-baa4-07e587cb6199"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.354377 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.354004    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-certs" pod "9703dc85-1cd0-44c8-881a-1a84c54961ad" (UID: "9703dc85-1cd0-44c8-881a-1a84c54961ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.354377 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.354329    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9703dc85-1cd0-44c8-881a-1a84c54961ad-istiod-ca-cert" pod "9703dc85-1cd0-44c8-881a-1a84c54961ad" (UID: "9703dc85-1cd0-44c8-881a-1a84c54961ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:00.354631 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.354606    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.354742 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.354698    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de72904-4846-4ae7-baa4-07e587cb6199-istiod-ca-cert" pod "7de72904-4846-4ae7-baa4-07e587cb6199" (UID: "7de72904-4846-4ae7-baa4-07e587cb6199"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:00.354936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.354750    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-credential-socket" pod "82c15701-2c8e-4ec6-909b-e6cb642b42f4" (UID: "82c15701-2c8e-4ec6-909b-e6cb642b42f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.354936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.354902    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-socket" pod "7de72904-4846-4ae7-baa4-07e587cb6199" (UID: "7de72904-4846-4ae7-baa4-07e587cb6199"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.356523 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.356467    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-envoy" pod "9703dc85-1cd0-44c8-881a-1a84c54961ad" (UID: "9703dc85-1cd0-44c8-881a-1a84c54961ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.356523 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.356487    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-envoy" pod "82c15701-2c8e-4ec6-909b-e6cb642b42f4" (UID: "82c15701-2c8e-4ec6-909b-e6cb642b42f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.356733 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.356708    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-kube-api-access-c8cn8" pod "82c15701-2c8e-4ec6-909b-e6cb642b42f4" (UID: "82c15701-2c8e-4ec6-909b-e6cb642b42f4"). InnerVolumeSpecName "kube-api-access-c8cn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.356836 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.356817    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-kube-api-access-p8kw2" pod "7de72904-4846-4ae7-baa4-07e587cb6199" (UID: "7de72904-4846-4ae7-baa4-07e587cb6199"). InnerVolumeSpecName "kube-api-access-p8kw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.357075 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.357053    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-kube-api-access-h7pkn" pod "9703dc85-1cd0-44c8-881a-1a84c54961ad" (UID: "9703dc85-1cd0-44c8-881a-1a84c54961ad"). InnerVolumeSpecName "kube-api-access-h7pkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.357236 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.357202    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-token" pod "9703dc85-1cd0-44c8-881a-1a84c54961ad" (UID: "9703dc85-1cd0-44c8-881a-1a84c54961ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.357236 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.357208    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-envoy" pod "7de72904-4846-4ae7-baa4-07e587cb6199" (UID: "7de72904-4846-4ae7-baa4-07e587cb6199"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:00.357383 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.357254    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-podinfo" pod "9703dc85-1cd0-44c8-881a-1a84c54961ad" (UID: "9703dc85-1cd0-44c8-881a-1a84c54961ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:00.357383 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.357274    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7de72904-4846-4ae7-baa4-07e587cb6199-istio-podinfo" pod "7de72904-4846-4ae7-baa4-07e587cb6199" (UID: "7de72904-4846-4ae7-baa4-07e587cb6199"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:00.357448 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.357417    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-istio-token" pod "7de72904-4846-4ae7-baa4-07e587cb6199" (UID: "7de72904-4846-4ae7-baa4-07e587cb6199"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.357792 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.357776    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-token" pod "82c15701-2c8e-4ec6-909b-e6cb642b42f4" (UID: "82c15701-2c8e-4ec6-909b-e6cb642b42f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.358653 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.358623    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-podinfo" pod "82c15701-2c8e-4ec6-909b-e6cb642b42f4" (UID: "82c15701-2c8e-4ec6-909b-e6cb642b42f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:00.455827 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455738    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.455827 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455771    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.455827 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455781    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.455827 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455790    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.455827 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455800    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.455827 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455811    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8kw2\" (UniqueName: \"kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-kube-api-access-p8kw2\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.455827 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455822    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de72904-4846-4ae7-baa4-07e587cb6199-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.455827 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455832    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8cn8\" (UniqueName: \"kubernetes.io/projected/82c15701-2c8e-4ec6-909b-e6cb642b42f4-kube-api-access-c8cn8\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.456229 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455841    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.456229 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455848    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.456229 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455856    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9703dc85-1cd0-44c8-881a-1a84c54961ad-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.456229 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455865    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7de72904-4846-4ae7-baa4-07e587cb6199-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.456229 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455873    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82c15701-2c8e-4ec6-909b-e6cb642b42f4-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.456229 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455881    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.456229 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455888    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7pkn\" (UniqueName: \"kubernetes.io/projected/9703dc85-1cd0-44c8-881a-1a84c54961ad-kube-api-access-h7pkn\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.456229 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455898    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7de72904-4846-4ae7-baa4-07e587cb6199-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.456229 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455906    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7de72904-4846-4ae7-baa4-07e587cb6199-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.456229 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:00.455914    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9703dc85-1cd0-44c8-881a-1a84c54961ad-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:01.188628 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.188598    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"
Oct 30 21:03:01.188628 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.188615    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7" event={"ID":"7de72904-4846-4ae7-baa4-07e587cb6199","Type":"ContainerDied","Data":"68d10d1195f1131dcb32138ca3e68fc10e9552a6844198a1f88c549925049510"}
Oct 30 21:03:01.188886 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.188740    6048 scope.go:122] "RemoveContainer" containerID="53a01d98cb1e23c27c144ff0dc61efa59aa8756a6cbba8c926c37507294e5f4a"
Oct 30 21:03:01.190178 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.190137    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb" event={"ID":"82c15701-2c8e-4ec6-909b-e6cb642b42f4","Type":"ContainerDied","Data":"47b5e1bd1e1b4c4a3c78293d25d071fbbdae4d942067417739b42cdcf0aa9c7f"}
Oct 30 21:03:01.190264 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.190255    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"
Oct 30 21:03:01.200351 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.200325    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"
Oct 30 21:03:01.200751 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.200733    6048 scope.go:122] "RemoveContainer" containerID="344e3e1bd012486d27a13924bc94f464010ad54efc7edc8c595b3a4fbdbbb4e4"
Oct 30 21:03:01.227075 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.227048    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"]
Oct 30 21:03:01.236566 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.236539    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-5t2z7"]
Oct 30 21:03:01.262501 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.262469    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e1a4e79-7954-407f-b9a7-fa5163bb099a" path="/var/lib/kubelet/pods/2e1a4e79-7954-407f-b9a7-fa5163bb099a/volumes"
Oct 30 21:03:01.263057 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.263040    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7de72904-4846-4ae7-baa4-07e587cb6199" path="/var/lib/kubelet/pods/7de72904-4846-4ae7-baa4-07e587cb6199/volumes"
Oct 30 21:03:01.263430 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.263417    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb223380-c1c3-4a02-8cc0-5021e8d258af" path="/var/lib/kubelet/pods/bb223380-c1c3-4a02-8cc0-5021e8d258af/volumes"
Oct 30 21:03:01.263721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.263708    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"]
Oct 30 21:03:01.264802 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.264769    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-p52fb"]
Oct 30 21:03:01.279063 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.279041    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"]
Oct 30 21:03:01.287098 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:01.286765    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-4a0c5b-openshift-default-676865df99-z7dxf"]
Oct 30 21:03:03.259425 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:03.259389    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" path="/var/lib/kubelet/pods/82c15701-2c8e-4ec6-909b-e6cb642b42f4/volumes"
Oct 30 21:03:03.259948 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:03.259924    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" path="/var/lib/kubelet/pods/9703dc85-1cd0-44c8-881a-1a84c54961ad/volumes"
Oct 30 21:03:05.097050 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:05.094079    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"]
Oct 30 21:03:05.172048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:05.154379    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-5a8f94-b6gpm"]
Oct 30 21:03:05.316873 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:05.316833    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2201cfee-77ba-46b7-b508-efbdaa6c8dd1" path="/var/lib/kubelet/pods/2201cfee-77ba-46b7-b508-efbdaa6c8dd1/volumes"
Oct 30 21:03:05.799154 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:05.799110    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podUID="18730625-e6ba-421a-9a27-02acc29e9a2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.31:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:03:05.920534 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:05.920485    6048 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm" podUID="18730625-e6ba-421a-9a27-02acc29e9a2b" containerName="main" probeResult="failure" output="Get \"https://10.134.0.31:8000/health\": context deadline exceeded"
Oct 30 21:03:06.164224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:06.164166    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:03:07.228079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:07.223456    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"]
Oct 30 21:03:07.228079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:07.223763    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy" containerID="cri-o://9259521c28baf4e7db0ebb0e05716311985a47a80a5250ce27ac6c6ac962a790" gracePeriod=30
Oct 30 21:03:07.230096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:07.229747    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"]
Oct 30 21:03:07.230096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:07.229942    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerName="istio-proxy" containerID="cri-o://df8e82eff8b7df8464b9e09ecb425d5daf5680988aeffc161ccddb140f41c9d0" gracePeriod=30
Oct 30 21:03:07.235655 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:07.235623    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"]
Oct 30 21:03:07.235914 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:07.235872    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerName="istio-proxy" containerID="cri-o://0b85b680f5d324ed52b2e20a64ac02ca46f5daa9f5b8fc9cd93bab2a5a771dde" gracePeriod=30
Oct 30 21:03:07.585212 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:07.585155    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"]
Oct 30 21:03:07.585451 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:07.585397    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" podUID="24721fde-f300-468a-8621-e2e98ce6a888" containerName="istio-proxy" containerID="cri-o://57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482" gracePeriod=30
Oct 30 21:03:07.611840 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:07.611786    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"]
Oct 30 21:03:07.612415 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:07.612374    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy" containerID="cri-o://11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57" gracePeriod=30
Oct 30 21:03:07.615854 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:07.615830    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"]
Oct 30 21:03:07.616237 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:07.616171    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy" containerID="cri-o://94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519" gracePeriod=30
Oct 30 21:03:09.637552 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:09.637501    6048 patch_prober.go:29] interesting pod/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:03:09.638057 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:09.637595    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:03:12.461322 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.461282    6048 generic.go:356] "Generic (PLEG): container finished" podID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerID="0b85b680f5d324ed52b2e20a64ac02ca46f5daa9f5b8fc9cd93bab2a5a771dde" exitCode=0
Oct 30 21:03:12.461717 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.461436    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" event={"ID":"0bef2832-cf0e-4334-9d10-0d123781cdb4","Type":"ContainerDied","Data":"0b85b680f5d324ed52b2e20a64ac02ca46f5daa9f5b8fc9cd93bab2a5a771dde"}
Oct 30 21:03:12.464078 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.464048    6048 generic.go:356] "Generic (PLEG): container finished" podID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerID="9259521c28baf4e7db0ebb0e05716311985a47a80a5250ce27ac6c6ac962a790" exitCode=0
Oct 30 21:03:12.464197 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.464131    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" event={"ID":"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c","Type":"ContainerDied","Data":"9259521c28baf4e7db0ebb0e05716311985a47a80a5250ce27ac6c6ac962a790"}
Oct 30 21:03:12.464197 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.464187    6048 scope.go:122] "RemoveContainer" containerID="c197a4af0256d37021e5f5504e9aefae64828fb5f18a9426c54526d2b87df44a"
Oct 30 21:03:12.471069 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.467212    6048 generic.go:356] "Generic (PLEG): container finished" podID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerID="df8e82eff8b7df8464b9e09ecb425d5daf5680988aeffc161ccddb140f41c9d0" exitCode=0
Oct 30 21:03:12.471069 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.467282    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" event={"ID":"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a","Type":"ContainerDied","Data":"df8e82eff8b7df8464b9e09ecb425d5daf5680988aeffc161ccddb140f41c9d0"}
Oct 30 21:03:12.526335 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.526302    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 21:03:12.545940 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.545909    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:03:12.584674 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.584645    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:03:12.599066 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599000    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istiod-ca-cert\") pod \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") "
Oct 30 21:03:12.599208 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599095    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-token\" (UniqueName: \"kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-token\") pod \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") "
Oct 30 21:03:12.599208 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599178    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-socket\") pod \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") "
Oct 30 21:03:12.599390 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599268    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-certs\") pod \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") "
Oct 30 21:03:12.599390 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599309    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-data\") pod \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") "
Oct 30 21:03:12.599390 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599342    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-credential-socket\") pod \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") "
Oct 30 21:03:12.599535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599392    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-kube-api-access-vrp4b\" (UniqueName: \"kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-kube-api-access-vrp4b\") pod \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") "
Oct 30 21:03:12.599535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599410    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-socket" pod "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" (UID: "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.599535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599417    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istiod-ca-cert" pod "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" (UID: "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:12.599535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599431    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-podinfo\") pod \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") "
Oct 30 21:03:12.599535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599466    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istiod-ca-cert\") pod \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") "
Oct 30 21:03:12.599535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599496    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-envoy\") pod \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") "
Oct 30 21:03:12.599535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599528    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-credential-socket\") pod \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") "
Oct 30 21:03:12.599892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599594    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-data" pod "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" (UID: "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.599892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599600    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-data\") pod \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") "
Oct 30 21:03:12.599892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599630    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-credential-socket" pod "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" (UID: "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.599892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599671    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-podinfo\") pod \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") "
Oct 30 21:03:12.599892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599733    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-token\" (UniqueName: \"kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-token\") pod \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") "
Oct 30 21:03:12.599892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599812    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-certs" pod "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" (UID: "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.599892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599820    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-kube-api-access-85b5c\" (UniqueName: \"kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-kube-api-access-85b5c\") pod \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") "
Oct 30 21:03:12.599892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599826    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-data" pod "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" (UID: "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.599892 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599859    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-certs\") pod \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\" (UID: \"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c\") "
Oct 30 21:03:12.600371 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.599948    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-socket\") pod \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") "
Oct 30 21:03:12.600371 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.600006    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-envoy\") pod \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\" (UID: \"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a\") "
Oct 30 21:03:12.600371 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.600060    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-credential-socket" pod "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" (UID: "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.600371 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.600247    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-certs" pod "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" (UID: "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.600721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.600696    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.600797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.600728    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.600797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.600745    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.600797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.600760    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.600797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.600775    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.600797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.600790    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.601080 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.600805    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.601080 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.600821    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.601080 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.601063    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-socket" pod "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" (UID: "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.602493 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.602463    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-envoy" pod "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" (UID: "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.602716 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.602638    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-podinfo" pod "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" (UID: "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:12.602847 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.602802    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-kube-api-access-85b5c" pod "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" (UID: "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c"). InnerVolumeSpecName "kube-api-access-85b5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:12.602847 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.602808    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istiod-ca-cert" pod "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" (UID: "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:12.603489 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.603302    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-podinfo" pod "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" (UID: "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:12.603489 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.603363    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-token" pod "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" (UID: "a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:12.603489 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.603467    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-token" pod "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" (UID: "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:12.603628 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.603494    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-envoy" pod "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" (UID: "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.603806 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.603786    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-kube-api-access-vrp4b" pod "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" (UID: "f5726e1a-1ae0-43b1-a6bb-386850c9ef8a"). InnerVolumeSpecName "kube-api-access-vrp4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:12.701761 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.701729    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-certs\") pod \"0bef2832-cf0e-4334-9d10-0d123781cdb4\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") "
Oct 30 21:03:12.701941 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.701783    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-envoy\") pod \"0bef2832-cf0e-4334-9d10-0d123781cdb4\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") "
Oct 30 21:03:12.701941 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.701908    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-socket\") pod \"0bef2832-cf0e-4334-9d10-0d123781cdb4\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") "
Oct 30 21:03:12.702070 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.701945    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-credential-socket\") pod \"0bef2832-cf0e-4334-9d10-0d123781cdb4\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") "
Oct 30 21:03:12.702070 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.701976    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0bef2832-cf0e-4334-9d10-0d123781cdb4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bef2832-cf0e-4334-9d10-0d123781cdb4-istiod-ca-cert\") pod \"0bef2832-cf0e-4334-9d10-0d123781cdb4\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") "
Oct 30 21:03:12.702070 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702010    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-kube-api-access-qpvn6\" (UniqueName: \"kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-kube-api-access-qpvn6\") pod \"0bef2832-cf0e-4334-9d10-0d123781cdb4\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") "
Oct 30 21:03:12.702250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702073    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-certs" pod "0bef2832-cf0e-4334-9d10-0d123781cdb4" (UID: "0bef2832-cf0e-4334-9d10-0d123781cdb4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.702250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702107    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-token\" (UniqueName: \"kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-token\") pod \"0bef2832-cf0e-4334-9d10-0d123781cdb4\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") "
Oct 30 21:03:12.702250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702146    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-data\") pod \"0bef2832-cf0e-4334-9d10-0d123781cdb4\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") "
Oct 30 21:03:12.702250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702204    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-podinfo\") pod \"0bef2832-cf0e-4334-9d10-0d123781cdb4\" (UID: \"0bef2832-cf0e-4334-9d10-0d123781cdb4\") "
Oct 30 21:03:12.702250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702228    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-socket" pod "0bef2832-cf0e-4334-9d10-0d123781cdb4" (UID: "0bef2832-cf0e-4334-9d10-0d123781cdb4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.702501 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702467    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-data" pod "0bef2832-cf0e-4334-9d10-0d123781cdb4" (UID: "0bef2832-cf0e-4334-9d10-0d123781cdb4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.702571 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702551    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bef2832-cf0e-4334-9d10-0d123781cdb4-istiod-ca-cert" pod "0bef2832-cf0e-4334-9d10-0d123781cdb4" (UID: "0bef2832-cf0e-4334-9d10-0d123781cdb4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:12.702571 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702551    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-credential-socket" pod "0bef2832-cf0e-4334-9d10-0d123781cdb4" (UID: "0bef2832-cf0e-4334-9d10-0d123781cdb4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.702798 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702774    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.702882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702806    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrp4b\" (UniqueName: \"kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-kube-api-access-vrp4b\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.702882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702823    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.702882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702836    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.702882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702850    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.702882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702865    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.702882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702879    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.703209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702893    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.703209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702907    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85b5c\" (UniqueName: \"kubernetes.io/projected/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c-kube-api-access-85b5c\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.703209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702921    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.703209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702935    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.703209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702949    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.703209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702963    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.703209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702977    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bef2832-cf0e-4334-9d10-0d123781cdb4-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.703209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.702991    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.704373 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.704349    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-podinfo" pod "0bef2832-cf0e-4334-9d10-0d123781cdb4" (UID: "0bef2832-cf0e-4334-9d10-0d123781cdb4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:12.704553 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.704530    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-kube-api-access-qpvn6" pod "0bef2832-cf0e-4334-9d10-0d123781cdb4" (UID: "0bef2832-cf0e-4334-9d10-0d123781cdb4"). InnerVolumeSpecName "kube-api-access-qpvn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:12.704804 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.704781    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-envoy" pod "0bef2832-cf0e-4334-9d10-0d123781cdb4" (UID: "0bef2832-cf0e-4334-9d10-0d123781cdb4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:12.704804 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.704798    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-token" pod "0bef2832-cf0e-4334-9d10-0d123781cdb4" (UID: "0bef2832-cf0e-4334-9d10-0d123781cdb4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:12.804481 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.804394    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpvn6\" (UniqueName: \"kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-kube-api-access-qpvn6\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.804481 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.804428    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.804481 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.804445    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.804481 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.804459    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bef2832-cf0e-4334-9d10-0d123781cdb4-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:12.916478 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.916449    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:03:12.941281 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.941253    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 21:03:12.945164 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:12.945140    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:03:13.006456 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.006421    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-kube-api-access-mp6mq\" (UniqueName: \"kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-kube-api-access-mp6mq\") pod \"81a9336f-fae4-47ca-bf38-e894ccde4f49\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") "
Oct 30 21:03:13.006628 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.006473    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-envoy\") pod \"81a9336f-fae4-47ca-bf38-e894ccde4f49\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") "
Oct 30 21:03:13.006628 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.006585    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-certs\") pod \"2a61036c-ce15-46cb-a653-fabd401a29d3\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") "
Oct 30 21:03:13.006770 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.006649    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-kube-api-access-5btbz\" (UniqueName: \"kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-kube-api-access-5btbz\") pod \"2a61036c-ce15-46cb-a653-fabd401a29d3\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") "
Oct 30 21:03:13.006896 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.006869    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-certs" pod "2a61036c-ce15-46cb-a653-fabd401a29d3" (UID: "2a61036c-ce15-46cb-a653-fabd401a29d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.007080 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007054    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-podinfo\") pod \"81a9336f-fae4-47ca-bf38-e894ccde4f49\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") "
Oct 30 21:03:13.007167 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007116    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2a61036c-ce15-46cb-a653-fabd401a29d3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a61036c-ce15-46cb-a653-fabd401a29d3-istiod-ca-cert\") pod \"2a61036c-ce15-46cb-a653-fabd401a29d3\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") "
Oct 30 21:03:13.007222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007170    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-podinfo\") pod \"2a61036c-ce15-46cb-a653-fabd401a29d3\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") "
Oct 30 21:03:13.007222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007210    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-envoy\") pod \"2a61036c-ce15-46cb-a653-fabd401a29d3\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") "
Oct 30 21:03:13.007334 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007264    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-token\" (UniqueName: \"kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-token\") pod \"2a61036c-ce15-46cb-a653-fabd401a29d3\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") "
Oct 30 21:03:13.007334 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007290    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-data\") pod \"2a61036c-ce15-46cb-a653-fabd401a29d3\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") "
Oct 30 21:03:13.007334 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007324    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-credential-socket\") pod \"81a9336f-fae4-47ca-bf38-e894ccde4f49\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") "
Oct 30 21:03:13.007485 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007361    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81a9336f-fae4-47ca-bf38-e894ccde4f49-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81a9336f-fae4-47ca-bf38-e894ccde4f49-istiod-ca-cert\") pod \"81a9336f-fae4-47ca-bf38-e894ccde4f49\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") "
Oct 30 21:03:13.007485 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007408    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-credential-socket\") pod \"24721fde-f300-468a-8621-e2e98ce6a888\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") "
Oct 30 21:03:13.007485 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007435    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-kube-api-access-l6tlf\" (UniqueName: \"kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-kube-api-access-l6tlf\") pod \"24721fde-f300-468a-8621-e2e98ce6a888\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") "
Oct 30 21:03:13.007649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007508    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-credential-socket\") pod \"2a61036c-ce15-46cb-a653-fabd401a29d3\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") "
Oct 30 21:03:13.007792 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007767    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-data" pod "2a61036c-ce15-46cb-a653-fabd401a29d3" (UID: "2a61036c-ce15-46cb-a653-fabd401a29d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.008003 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.007909    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-credential-socket" pod "24721fde-f300-468a-8621-e2e98ce6a888" (UID: "24721fde-f300-468a-8621-e2e98ce6a888"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.008152 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.008126    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-credential-socket" pod "81a9336f-fae4-47ca-bf38-e894ccde4f49" (UID: "81a9336f-fae4-47ca-bf38-e894ccde4f49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.008282 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.008262    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81a9336f-fae4-47ca-bf38-e894ccde4f49-istiod-ca-cert" pod "81a9336f-fae4-47ca-bf38-e894ccde4f49" (UID: "81a9336f-fae4-47ca-bf38-e894ccde4f49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:13.008353 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.008292    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-data\") pod \"24721fde-f300-468a-8621-e2e98ce6a888\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") "
Oct 30 21:03:13.008410 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.008367    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-socket\") pod \"81a9336f-fae4-47ca-bf38-e894ccde4f49\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") "
Oct 30 21:03:13.008733 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.008563    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-data" pod "24721fde-f300-468a-8621-e2e98ce6a888" (UID: "24721fde-f300-468a-8621-e2e98ce6a888"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.008733 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.008659    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-envoy\") pod \"24721fde-f300-468a-8621-e2e98ce6a888\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") "
Oct 30 21:03:13.008733 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.008694    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-socket" pod "81a9336f-fae4-47ca-bf38-e894ccde4f49" (UID: "81a9336f-fae4-47ca-bf38-e894ccde4f49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.009064 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.008999    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-data" pod "81a9336f-fae4-47ca-bf38-e894ccde4f49" (UID: "81a9336f-fae4-47ca-bf38-e894ccde4f49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.009130 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.009071    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-data\") pod \"81a9336f-fae4-47ca-bf38-e894ccde4f49\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") "
Oct 30 21:03:13.009130 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.009122    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-token\" (UniqueName: \"kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-token\") pod \"81a9336f-fae4-47ca-bf38-e894ccde4f49\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") "
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.009701    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-certs\") pod \"81a9336f-fae4-47ca-bf38-e894ccde4f49\" (UID: \"81a9336f-fae4-47ca-bf38-e894ccde4f49\") "
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.009826    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/24721fde-f300-468a-8621-e2e98ce6a888-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24721fde-f300-468a-8621-e2e98ce6a888-istiod-ca-cert\") pod \"24721fde-f300-468a-8621-e2e98ce6a888\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") "
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.009918    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-certs\") pod \"24721fde-f300-468a-8621-e2e98ce6a888\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") "
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.009958    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-istio-token\" (UniqueName: \"kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-istio-token\") pod \"24721fde-f300-468a-8621-e2e98ce6a888\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") "
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.010015    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/24721fde-f300-468a-8621-e2e98ce6a888-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24721fde-f300-468a-8621-e2e98ce6a888-istio-podinfo\") pod \"24721fde-f300-468a-8621-e2e98ce6a888\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") "
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.010110    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-socket\") pod \"24721fde-f300-468a-8621-e2e98ce6a888\" (UID: \"24721fde-f300-468a-8621-e2e98ce6a888\") "
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.009525    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a61036c-ce15-46cb-a653-fabd401a29d3-istiod-ca-cert" pod "2a61036c-ce15-46cb-a653-fabd401a29d3" (UID: "2a61036c-ce15-46cb-a653-fabd401a29d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.010182    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-socket\") pod \"2a61036c-ce15-46cb-a653-fabd401a29d3\" (UID: \"2a61036c-ce15-46cb-a653-fabd401a29d3\") "
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.010352    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-certs" pod "24721fde-f300-468a-8621-e2e98ce6a888" (UID: "24721fde-f300-468a-8621-e2e98ce6a888"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.010643    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24721fde-f300-468a-8621-e2e98ce6a888-istiod-ca-cert" pod "24721fde-f300-468a-8621-e2e98ce6a888" (UID: "24721fde-f300-468a-8621-e2e98ce6a888"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.010879    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-socket" pod "2a61036c-ce15-46cb-a653-fabd401a29d3" (UID: "2a61036c-ce15-46cb-a653-fabd401a29d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.010991    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81a9336f-fae4-47ca-bf38-e894ccde4f49-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011013    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011047    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011061    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011075    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011089    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24721fde-f300-468a-8621-e2e98ce6a888-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011091    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-socket" pod "24721fde-f300-468a-8621-e2e98ce6a888" (UID: "24721fde-f300-468a-8621-e2e98ce6a888"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011105    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011121    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011135    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a61036c-ce15-46cb-a653-fabd401a29d3-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011141    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-certs" pod "81a9336f-fae4-47ca-bf38-e894ccde4f49" (UID: "81a9336f-fae4-47ca-bf38-e894ccde4f49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011150    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011164    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.011263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.011232    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-credential-socket" pod "2a61036c-ce15-46cb-a653-fabd401a29d3" (UID: "2a61036c-ce15-46cb-a653-fabd401a29d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.013464 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.013438    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-envoy" pod "24721fde-f300-468a-8621-e2e98ce6a888" (UID: "24721fde-f300-468a-8621-e2e98ce6a888"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.013950 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.013851    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-podinfo" pod "81a9336f-fae4-47ca-bf38-e894ccde4f49" (UID: "81a9336f-fae4-47ca-bf38-e894ccde4f49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:13.014590 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.014546    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-envoy" pod "81a9336f-fae4-47ca-bf38-e894ccde4f49" (UID: "81a9336f-fae4-47ca-bf38-e894ccde4f49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.014590 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.014584    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-kube-api-access-mp6mq" pod "81a9336f-fae4-47ca-bf38-e894ccde4f49" (UID: "81a9336f-fae4-47ca-bf38-e894ccde4f49"). InnerVolumeSpecName "kube-api-access-mp6mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.015389 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.015328    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24721fde-f300-468a-8621-e2e98ce6a888-istio-podinfo" pod "24721fde-f300-468a-8621-e2e98ce6a888" (UID: "24721fde-f300-468a-8621-e2e98ce6a888"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:13.015389 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.015333    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-token" pod "2a61036c-ce15-46cb-a653-fabd401a29d3" (UID: "2a61036c-ce15-46cb-a653-fabd401a29d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.016154 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.015512    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-token" pod "81a9336f-fae4-47ca-bf38-e894ccde4f49" (UID: "81a9336f-fae4-47ca-bf38-e894ccde4f49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.016154 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.015519    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-envoy" pod "2a61036c-ce15-46cb-a653-fabd401a29d3" (UID: "2a61036c-ce15-46cb-a653-fabd401a29d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:13.016154 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.015715    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-kube-api-access-5btbz" pod "2a61036c-ce15-46cb-a653-fabd401a29d3" (UID: "2a61036c-ce15-46cb-a653-fabd401a29d3"). InnerVolumeSpecName "kube-api-access-5btbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.016154 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.015892    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-podinfo" pod "2a61036c-ce15-46cb-a653-fabd401a29d3" (UID: "2a61036c-ce15-46cb-a653-fabd401a29d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:13.017073 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.016992    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-kube-api-access-l6tlf" pod "24721fde-f300-468a-8621-e2e98ce6a888" (UID: "24721fde-f300-468a-8621-e2e98ce6a888"). InnerVolumeSpecName "kube-api-access-l6tlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.017460 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.017427    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-istio-token" pod "24721fde-f300-468a-8621-e2e98ce6a888" (UID: "24721fde-f300-468a-8621-e2e98ce6a888"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:13.111783 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111750    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.111783 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111781    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.111783 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111791    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111800    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111810    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111818    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24721fde-f300-468a-8621-e2e98ce6a888-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111827    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24721fde-f300-468a-8621-e2e98ce6a888-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111836    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111847    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp6mq\" (UniqueName: \"kubernetes.io/projected/81a9336f-fae4-47ca-bf38-e894ccde4f49-kube-api-access-mp6mq\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111856    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111865    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5btbz\" (UniqueName: \"kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-kube-api-access-5btbz\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111873    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81a9336f-fae4-47ca-bf38-e894ccde4f49-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111881    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111891    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111901    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a61036c-ce15-46cb-a653-fabd401a29d3-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.112079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.111910    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6tlf\" (UniqueName: \"kubernetes.io/projected/24721fde-f300-468a-8621-e2e98ce6a888-kube-api-access-l6tlf\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:13.475667 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.475585    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"
Oct 30 21:03:13.475667 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.475602    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87" event={"ID":"0bef2832-cf0e-4334-9d10-0d123781cdb4","Type":"ContainerDied","Data":"c657655d607d2e227a13496f3696d0dd1978c6b3709b8109f646a2d6a6f773a2"}
Oct 30 21:03:13.476553 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.475693    6048 scope.go:122] "RemoveContainer" containerID="0b85b680f5d324ed52b2e20a64ac02ca46f5daa9f5b8fc9cd93bab2a5a771dde"
Oct 30 21:03:13.478229 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.478208    6048 generic.go:356] "Generic (PLEG): container finished" podID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerID="94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519" exitCode=0
Oct 30 21:03:13.478367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.478277    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"
Oct 30 21:03:13.478367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.478297    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" event={"ID":"81a9336f-fae4-47ca-bf38-e894ccde4f49","Type":"ContainerDied","Data":"94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519"}
Oct 30 21:03:13.478469 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.478373    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs" event={"ID":"81a9336f-fae4-47ca-bf38-e894ccde4f49","Type":"ContainerDied","Data":"1dd81b7383bd68689cbfc84994fd7e6f2d342b15b4d5ea06cd1e8f3acda7a5b3"}
Oct 30 21:03:13.480770 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.480720    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf" event={"ID":"a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c","Type":"ContainerDied","Data":"b2d4b3f89f1efcb8f690ee487064001c0d7009a19169e250e3d9864de2d17f54"}
Oct 30 21:03:13.480770 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.480735    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"
Oct 30 21:03:13.482523 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.482502    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"
Oct 30 21:03:13.482624 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.482504    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd" event={"ID":"f5726e1a-1ae0-43b1-a6bb-386850c9ef8a","Type":"ContainerDied","Data":"32179af4f3255d4896c5307d8f06605719c39c6ca1b0428a0173e2fe695b63f6"}
Oct 30 21:03:13.484104 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.484081    6048 generic.go:356] "Generic (PLEG): container finished" podID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerID="11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57" exitCode=0
Oct 30 21:03:13.484321 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.484302    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" event={"ID":"2a61036c-ce15-46cb-a653-fabd401a29d3","Type":"ContainerDied","Data":"11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57"}
Oct 30 21:03:13.484364 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.484351    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k" event={"ID":"2a61036c-ce15-46cb-a653-fabd401a29d3","Type":"ContainerDied","Data":"b3d8e959d6de10fe71fdc1ad6cfae54239ac8caf8d488060d54e9ab5cc8a48aa"}
Oct 30 21:03:13.484453 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.484439    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"
Oct 30 21:03:13.486538 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.486519    6048 generic.go:356] "Generic (PLEG): container finished" podID="24721fde-f300-468a-8621-e2e98ce6a888" containerID="57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482" exitCode=0
Oct 30 21:03:13.486636 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.486561    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" event={"ID":"24721fde-f300-468a-8621-e2e98ce6a888","Type":"ContainerDied","Data":"57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482"}
Oct 30 21:03:13.486636 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.486599    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk" event={"ID":"24721fde-f300-468a-8621-e2e98ce6a888","Type":"ContainerDied","Data":"477ca92c510b56e21af711d38b016c4658b9c04e682ebac3f685d5a96bebaa31"}
Oct 30 21:03:13.486740 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.486672    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"
Oct 30 21:03:13.489340 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.489321    6048 scope.go:122] "RemoveContainer" containerID="94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519"
Oct 30 21:03:13.499864 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.499845    6048 scope.go:122] "RemoveContainer" containerID="ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3"
Oct 30 21:03:13.509117 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.509099    6048 scope.go:122] "RemoveContainer" containerID="94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519"
Oct 30 21:03:13.509411 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:03:13.509389    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519\": container with ID starting with 94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519 not found: ID does not exist" containerID="94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519"
Oct 30 21:03:13.509478 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.509420    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519"} err="failed to get container status \"94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519\": rpc error: code = NotFound desc = could not find container \"94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519\": container with ID starting with 94519780c5ecd8fcec59d3e5b68e4078199068da43036c63718ebfdaf8fe0519 not found: ID does not exist"
Oct 30 21:03:13.509478 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.509438    6048 scope.go:122] "RemoveContainer" containerID="ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3"
Oct 30 21:03:13.509714 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:03:13.509686    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3\": container with ID starting with ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3 not found: ID does not exist" containerID="ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3"
Oct 30 21:03:13.509779 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.509718    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3"} err="failed to get container status \"ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3\": rpc error: code = NotFound desc = could not find container \"ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3\": container with ID starting with ed9b9bfa3c245d6e269b8599c1e32959ed3920fda6e97f0dff9e1939d7f066d3 not found: ID does not exist"
Oct 30 21:03:13.509779 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.509739    6048 scope.go:122] "RemoveContainer" containerID="9259521c28baf4e7db0ebb0e05716311985a47a80a5250ce27ac6c6ac962a790"
Oct 30 21:03:13.514949 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.514925    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"]
Oct 30 21:03:13.520220 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.520200    6048 scope.go:122] "RemoveContainer" containerID="df8e82eff8b7df8464b9e09ecb425d5daf5680988aeffc161ccddb140f41c9d0"
Oct 30 21:03:13.524736 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.524716    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-4cf2k"]
Oct 30 21:03:13.529897 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.529876    6048 scope.go:122] "RemoveContainer" containerID="11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57"
Oct 30 21:03:13.539179 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.539153    6048 scope.go:122] "RemoveContainer" containerID="11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57"
Oct 30 21:03:13.539521 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:03:13.539489    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57\": container with ID starting with 11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57 not found: ID does not exist" containerID="11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57"
Oct 30 21:03:13.539628 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.539537    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57"} err="failed to get container status \"11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57\": rpc error: code = NotFound desc = could not find container \"11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57\": container with ID starting with 11dd6a1f42bc8d56faf0fb220b1a4d30e5f0a50832b62fefc7262b3678ca4b57 not found: ID does not exist"
Oct 30 21:03:13.539628 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.539563    6048 scope.go:122] "RemoveContainer" containerID="57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482"
Oct 30 21:03:13.548109 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.548083    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"]
Oct 30 21:03:13.552614 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.552587    6048 scope.go:122] "RemoveContainer" containerID="57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482"
Oct 30 21:03:13.552949 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:03:13.552925    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482\": container with ID starting with 57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482 not found: ID does not exist" containerID="57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482"
Oct 30 21:03:13.553013 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.552967    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482"} err="failed to get container status \"57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482\": rpc error: code = NotFound desc = could not find container \"57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482\": container with ID starting with 57ebec900345c4e9ebeea08b382d926c914f41ad47691e3d48cfb8b35d995482 not found: ID does not exist"
Oct 30 21:03:13.553586 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.553567    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-lxdbd"]
Oct 30 21:03:13.576807 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.576776    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"]
Oct 30 21:03:13.582302 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.582268    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-jt6vk"]
Oct 30 21:03:13.594355 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.594315    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"]
Oct 30 21:03:13.609789 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.609764    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-6nd87"]
Oct 30 21:03:13.627463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.627437    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"]
Oct 30 21:03:13.633846 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.633822    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c2d1eb-openshift-default-ddff45b59-h6nqf"]
Oct 30 21:03:13.653917 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.653891    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"]
Oct 30 21:03:13.659435 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:13.659411    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-65968b-openshift-default-68896fcddc-kjsxs"]
Oct 30 21:03:15.261437 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:15.261407    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" path="/var/lib/kubelet/pods/0bef2832-cf0e-4334-9d10-0d123781cdb4/volumes"
Oct 30 21:03:15.261874 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:15.261860    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="24721fde-f300-468a-8621-e2e98ce6a888" path="/var/lib/kubelet/pods/24721fde-f300-468a-8621-e2e98ce6a888/volumes"
Oct 30 21:03:15.262415 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:15.262397    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" path="/var/lib/kubelet/pods/2a61036c-ce15-46cb-a653-fabd401a29d3/volumes"
Oct 30 21:03:15.263129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:15.263115    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" path="/var/lib/kubelet/pods/81a9336f-fae4-47ca-bf38-e894ccde4f49/volumes"
Oct 30 21:03:15.263530 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:15.263518    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" path="/var/lib/kubelet/pods/a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c/volumes"
Oct 30 21:03:15.263932 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:15.263920    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" path="/var/lib/kubelet/pods/f5726e1a-1ae0-43b1-a6bb-386850c9ef8a/volumes"
Oct 30 21:03:15.264385 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:15.264369    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"]
Oct 30 21:03:15.264558 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:15.264541    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy" containerID="cri-o://5a5ad3e4d97ce1a7f9320e75b3f906ad6e2bac95790d34bfbbf4ffab8d220f44" gracePeriod=30
Oct 30 21:03:15.298337 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:15.298304    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"]
Oct 30 21:03:15.298512 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:15.298494    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" podUID="34e95215-8cbc-48d6-9cc6-06c01826d25f" containerName="istio-proxy" containerID="cri-o://e1148d653c0d42af192fd1682f9ca46ee4ec8b664a0f476264c8132f9bb261d5" gracePeriod=30
Oct 30 21:03:15.301056 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:15.301032    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"]
Oct 30 21:03:15.301246 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:15.301206    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" podUID="649feb12-6ac4-41a1-8632-e0faa768d083" containerName="istio-proxy" containerID="cri-o://dbbb47e1dd00e65154b5149257cfeb84099cfc81788b8f999cfeeb287e9516c8" gracePeriod=30
Oct 30 21:03:16.802960 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:03:16.802923    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:03:18.428171 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:18.428133    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:03:18.428574 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:18.428203    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" podUID="649feb12-6ac4-41a1-8632-e0faa768d083" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:03:18.923860 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:18.923824    6048 patch_prober.go:29] interesting pod/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:03:18.924102 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:18.923913    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" podUID="34e95215-8cbc-48d6-9cc6-06c01826d25f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:03:20.546981 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.546554    6048 generic.go:356] "Generic (PLEG): container finished" podID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerID="5a5ad3e4d97ce1a7f9320e75b3f906ad6e2bac95790d34bfbbf4ffab8d220f44" exitCode=0
Oct 30 21:03:20.546981 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.546882    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" event={"ID":"2e1d4ca7-3f79-4a4d-8661-8aed3d850449","Type":"ContainerDied","Data":"5a5ad3e4d97ce1a7f9320e75b3f906ad6e2bac95790d34bfbbf4ffab8d220f44"}
Oct 30 21:03:20.550302 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.550268    6048 generic.go:356] "Generic (PLEG): container finished" podID="34e95215-8cbc-48d6-9cc6-06c01826d25f" containerID="e1148d653c0d42af192fd1682f9ca46ee4ec8b664a0f476264c8132f9bb261d5" exitCode=0
Oct 30 21:03:20.550426 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.550364    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" event={"ID":"34e95215-8cbc-48d6-9cc6-06c01826d25f","Type":"ContainerDied","Data":"e1148d653c0d42af192fd1682f9ca46ee4ec8b664a0f476264c8132f9bb261d5"}
Oct 30 21:03:20.553689 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.553659    6048 generic.go:356] "Generic (PLEG): container finished" podID="649feb12-6ac4-41a1-8632-e0faa768d083" containerID="dbbb47e1dd00e65154b5149257cfeb84099cfc81788b8f999cfeeb287e9516c8" exitCode=0
Oct 30 21:03:20.553806 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.553710    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" event={"ID":"649feb12-6ac4-41a1-8632-e0faa768d083","Type":"ContainerDied","Data":"dbbb47e1dd00e65154b5149257cfeb84099cfc81788b8f999cfeeb287e9516c8"}
Oct 30 21:03:20.572658 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.572622    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:03:20.619848 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.619799    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 21:03:20.630794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.630770    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:03:20.697042 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697001    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-certs\") pod \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") "
Oct 30 21:03:20.697210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697060    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-token\" (UniqueName: \"kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-token\") pod \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") "
Oct 30 21:03:20.697210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697084    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-kube-api-access-tdgjk\" (UniqueName: \"kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-kube-api-access-tdgjk\") pod \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") "
Oct 30 21:03:20.697210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697107    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-kube-api-access-6brzn\" (UniqueName: \"kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-kube-api-access-6brzn\") pod \"649feb12-6ac4-41a1-8632-e0faa768d083\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") "
Oct 30 21:03:20.697210 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697143    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-podinfo\") pod \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") "
Oct 30 21:03:20.697428 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697309    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-data\") pod \"649feb12-6ac4-41a1-8632-e0faa768d083\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") "
Oct 30 21:03:20.697428 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697318    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-certs" pod "2e1d4ca7-3f79-4a4d-8661-8aed3d850449" (UID: "2e1d4ca7-3f79-4a4d-8661-8aed3d850449"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.697428 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697352    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/649feb12-6ac4-41a1-8632-e0faa768d083-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/649feb12-6ac4-41a1-8632-e0faa768d083-istio-podinfo\") pod \"649feb12-6ac4-41a1-8632-e0faa768d083\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") "
Oct 30 21:03:20.697428 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697389    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-istio-token\" (UniqueName: \"kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-istio-token\") pod \"649feb12-6ac4-41a1-8632-e0faa768d083\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") "
Oct 30 21:03:20.697617 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697431    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-credential-socket\") pod \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") "
Oct 30 21:03:20.697617 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697465    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-data\") pod \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") "
Oct 30 21:03:20.697617 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697506    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-socket\") pod \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") "
Oct 30 21:03:20.697617 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697538    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-envoy\") pod \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") "
Oct 30 21:03:20.697617 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697568    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-data" pod "649feb12-6ac4-41a1-8632-e0faa768d083" (UID: "649feb12-6ac4-41a1-8632-e0faa768d083"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.697617 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697577    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-socket\") pod \"649feb12-6ac4-41a1-8632-e0faa768d083\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") "
Oct 30 21:03:20.697929 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697659    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/649feb12-6ac4-41a1-8632-e0faa768d083-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/649feb12-6ac4-41a1-8632-e0faa768d083-istiod-ca-cert\") pod \"649feb12-6ac4-41a1-8632-e0faa768d083\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") "
Oct 30 21:03:20.697929 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697737    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-certs\") pod \"649feb12-6ac4-41a1-8632-e0faa768d083\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") "
Oct 30 21:03:20.697929 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697770    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-socket" pod "649feb12-6ac4-41a1-8632-e0faa768d083" (UID: "649feb12-6ac4-41a1-8632-e0faa768d083"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.697929 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697897    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-envoy\") pod \"649feb12-6ac4-41a1-8632-e0faa768d083\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") "
Oct 30 21:03:20.698207 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697937    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istiod-ca-cert\") pod \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\" (UID: \"2e1d4ca7-3f79-4a4d-8661-8aed3d850449\") "
Oct 30 21:03:20.698207 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697972    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-credential-socket" pod "2e1d4ca7-3f79-4a4d-8661-8aed3d850449" (UID: "2e1d4ca7-3f79-4a4d-8661-8aed3d850449"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.698207 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.697992    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-credential-socket\") pod \"649feb12-6ac4-41a1-8632-e0faa768d083\" (UID: \"649feb12-6ac4-41a1-8632-e0faa768d083\") "
Oct 30 21:03:20.698207 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.698197    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-data" pod "2e1d4ca7-3f79-4a4d-8661-8aed3d850449" (UID: "2e1d4ca7-3f79-4a4d-8661-8aed3d850449"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.698429 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.698393    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-credential-socket" pod "649feb12-6ac4-41a1-8632-e0faa768d083" (UID: "649feb12-6ac4-41a1-8632-e0faa768d083"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.698590 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.698567    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-socket" pod "2e1d4ca7-3f79-4a4d-8661-8aed3d850449" (UID: "2e1d4ca7-3f79-4a4d-8661-8aed3d850449"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.698700 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.698680    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.698769 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.698707    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.698769 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.698724    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.698769 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.698738    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.698769 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.698753    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.699367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.698767    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.699367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.698783    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.699367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.699127    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/649feb12-6ac4-41a1-8632-e0faa768d083-istiod-ca-cert" pod "649feb12-6ac4-41a1-8632-e0faa768d083" (UID: "649feb12-6ac4-41a1-8632-e0faa768d083"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:20.699367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.699183    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-certs" pod "649feb12-6ac4-41a1-8632-e0faa768d083" (UID: "649feb12-6ac4-41a1-8632-e0faa768d083"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.699367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.699259    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istiod-ca-cert" pod "2e1d4ca7-3f79-4a4d-8661-8aed3d850449" (UID: "2e1d4ca7-3f79-4a4d-8661-8aed3d850449"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:20.700359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.700328    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-podinfo" pod "2e1d4ca7-3f79-4a4d-8661-8aed3d850449" (UID: "2e1d4ca7-3f79-4a4d-8661-8aed3d850449"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:20.700359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.700347    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-kube-api-access-6brzn" pod "649feb12-6ac4-41a1-8632-e0faa768d083" (UID: "649feb12-6ac4-41a1-8632-e0faa768d083"). InnerVolumeSpecName "kube-api-access-6brzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:20.700968 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.700936    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-kube-api-access-tdgjk" pod "2e1d4ca7-3f79-4a4d-8661-8aed3d850449" (UID: "2e1d4ca7-3f79-4a4d-8661-8aed3d850449"). InnerVolumeSpecName "kube-api-access-tdgjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:20.701113 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.701082    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-envoy" pod "2e1d4ca7-3f79-4a4d-8661-8aed3d850449" (UID: "2e1d4ca7-3f79-4a4d-8661-8aed3d850449"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.701113 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.701093    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-istio-token" pod "649feb12-6ac4-41a1-8632-e0faa768d083" (UID: "649feb12-6ac4-41a1-8632-e0faa768d083"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:20.701213 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.701154    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-token" pod "2e1d4ca7-3f79-4a4d-8661-8aed3d850449" (UID: "2e1d4ca7-3f79-4a4d-8661-8aed3d850449"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:20.701788 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.701770    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/649feb12-6ac4-41a1-8632-e0faa768d083-istio-podinfo" pod "649feb12-6ac4-41a1-8632-e0faa768d083" (UID: "649feb12-6ac4-41a1-8632-e0faa768d083"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:20.701924 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.701892    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-envoy" pod "649feb12-6ac4-41a1-8632-e0faa768d083" (UID: "649feb12-6ac4-41a1-8632-e0faa768d083"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.799855 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.799761    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-podinfo\") pod \"34e95215-8cbc-48d6-9cc6-06c01826d25f\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") "
Oct 30 21:03:20.799855 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.799815    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-data\") pod \"34e95215-8cbc-48d6-9cc6-06c01826d25f\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") "
Oct 30 21:03:20.799855 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.799846    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-envoy\") pod \"34e95215-8cbc-48d6-9cc6-06c01826d25f\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") "
Oct 30 21:03:20.800165 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.799882    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-credential-socket\") pod \"34e95215-8cbc-48d6-9cc6-06c01826d25f\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") "
Oct 30 21:03:20.800165 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800077    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-kube-api-access-v6ffx\" (UniqueName: \"kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-kube-api-access-v6ffx\") pod \"34e95215-8cbc-48d6-9cc6-06c01826d25f\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") "
Oct 30 21:03:20.800165 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800132    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-socket\") pod \"34e95215-8cbc-48d6-9cc6-06c01826d25f\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") "
Oct 30 21:03:20.800315 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800181    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/34e95215-8cbc-48d6-9cc6-06c01826d25f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34e95215-8cbc-48d6-9cc6-06c01826d25f-istiod-ca-cert\") pod \"34e95215-8cbc-48d6-9cc6-06c01826d25f\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") "
Oct 30 21:03:20.800315 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800186    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-data" pod "34e95215-8cbc-48d6-9cc6-06c01826d25f" (UID: "34e95215-8cbc-48d6-9cc6-06c01826d25f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.800315 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800238    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-certs\") pod \"34e95215-8cbc-48d6-9cc6-06c01826d25f\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") "
Oct 30 21:03:20.800315 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800270    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-token\" (UniqueName: \"kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-token\") pod \"34e95215-8cbc-48d6-9cc6-06c01826d25f\" (UID: \"34e95215-8cbc-48d6-9cc6-06c01826d25f\") "
Oct 30 21:03:20.800515 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800230    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-credential-socket" pod "34e95215-8cbc-48d6-9cc6-06c01826d25f" (UID: "34e95215-8cbc-48d6-9cc6-06c01826d25f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.800515 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800432    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-socket" pod "34e95215-8cbc-48d6-9cc6-06c01826d25f" (UID: "34e95215-8cbc-48d6-9cc6-06c01826d25f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.800515 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800476    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34e95215-8cbc-48d6-9cc6-06c01826d25f-istiod-ca-cert" pod "34e95215-8cbc-48d6-9cc6-06c01826d25f" (UID: "34e95215-8cbc-48d6-9cc6-06c01826d25f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:20.800686 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800652    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-certs" pod "34e95215-8cbc-48d6-9cc6-06c01826d25f" (UID: "34e95215-8cbc-48d6-9cc6-06c01826d25f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.800800 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800776    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800800 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800798    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/649feb12-6ac4-41a1-8632-e0faa768d083-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800811    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800821    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800830    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/34e95215-8cbc-48d6-9cc6-06c01826d25f-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800838    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/649feb12-6ac4-41a1-8632-e0faa768d083-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800847    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800855    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800864    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800872    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800880    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdgjk\" (UniqueName: \"kubernetes.io/projected/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-kube-api-access-tdgjk\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800890    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6brzn\" (UniqueName: \"kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-kube-api-access-6brzn\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800903    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800916    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e1d4ca7-3f79-4a4d-8661-8aed3d850449-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800930    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/649feb12-6ac4-41a1-8632-e0faa768d083-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.800993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.800944    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/649feb12-6ac4-41a1-8632-e0faa768d083-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.802313 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.802292    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-envoy" pod "34e95215-8cbc-48d6-9cc6-06c01826d25f" (UID: "34e95215-8cbc-48d6-9cc6-06c01826d25f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:20.802447 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.802432    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-podinfo" pod "34e95215-8cbc-48d6-9cc6-06c01826d25f" (UID: "34e95215-8cbc-48d6-9cc6-06c01826d25f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:03:20.802542 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.802526    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-kube-api-access-v6ffx" pod "34e95215-8cbc-48d6-9cc6-06c01826d25f" (UID: "34e95215-8cbc-48d6-9cc6-06c01826d25f"). InnerVolumeSpecName "kube-api-access-v6ffx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:20.802770 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.802744    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-token" pod "34e95215-8cbc-48d6-9cc6-06c01826d25f" (UID: "34e95215-8cbc-48d6-9cc6-06c01826d25f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:20.902505 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.902468    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.902505 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.902498    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.902505 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.902508    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/34e95215-8cbc-48d6-9cc6-06c01826d25f-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:20.902718 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:20.902517    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6ffx\" (UniqueName: \"kubernetes.io/projected/34e95215-8cbc-48d6-9cc6-06c01826d25f-kube-api-access-v6ffx\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:21.561143 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.561113    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"
Oct 30 21:03:21.561621 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.561105    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz" event={"ID":"34e95215-8cbc-48d6-9cc6-06c01826d25f","Type":"ContainerDied","Data":"a83809ff052450f187d8e2e6480f36baa7a4b0bc510f36e35316f1960f04bff6"}
Oct 30 21:03:21.561621 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.561254    6048 scope.go:122] "RemoveContainer" containerID="e1148d653c0d42af192fd1682f9ca46ee4ec8b664a0f476264c8132f9bb261d5"
Oct 30 21:03:21.562692 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.562667    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw" event={"ID":"649feb12-6ac4-41a1-8632-e0faa768d083","Type":"ContainerDied","Data":"8b26323f4300c4be38fbd3f2e730e863dc7599f74eee9599a3fe0a154ccecda5"}
Oct 30 21:03:21.562775 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.562685    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"
Oct 30 21:03:21.564871 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.564821    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg" event={"ID":"2e1d4ca7-3f79-4a4d-8661-8aed3d850449","Type":"ContainerDied","Data":"ffa7c352a0c755d2d0bf66a1ca3093196701725361e14a27c7ca77bf755907bc"}
Oct 30 21:03:21.565046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.564888    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"
Oct 30 21:03:21.572661 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.572638    6048 scope.go:122] "RemoveContainer" containerID="dbbb47e1dd00e65154b5149257cfeb84099cfc81788b8f999cfeeb287e9516c8"
Oct 30 21:03:21.581757 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.581739    6048 scope.go:122] "RemoveContainer" containerID="5a5ad3e4d97ce1a7f9320e75b3f906ad6e2bac95790d34bfbbf4ffab8d220f44"
Oct 30 21:03:21.606401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.606350    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"]
Oct 30 21:03:21.609144 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.609123    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-l4zqg"]
Oct 30 21:03:21.642579 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.642543    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"]
Oct 30 21:03:21.647726 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.647697    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-x4shz"]
Oct 30 21:03:21.665785 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.665753    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"]
Oct 30 21:03:21.673545 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:21.673521    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-5a8f94-openshift-default-75588f8b8f-gnjcw"]
Oct 30 21:03:23.258823 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:23.258791    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" path="/var/lib/kubelet/pods/2e1d4ca7-3f79-4a4d-8661-8aed3d850449/volumes"
Oct 30 21:03:23.259261 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:23.259247    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="34e95215-8cbc-48d6-9cc6-06c01826d25f" path="/var/lib/kubelet/pods/34e95215-8cbc-48d6-9cc6-06c01826d25f/volumes"
Oct 30 21:03:23.259653 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:23.259641    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="649feb12-6ac4-41a1-8632-e0faa768d083" path="/var/lib/kubelet/pods/649feb12-6ac4-41a1-8632-e0faa768d083/volumes"
Oct 30 21:03:24.620222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620191    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"]
Oct 30 21:03:24.620721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620651    6048 cpu_manager.go:414] "containerMap: removing container" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy"
Oct 30 21:03:24.620721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620666    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy"
Oct 30 21:03:24.620721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620690    6048 cpu_manager.go:414] "containerMap: removing container" podUID="34e95215-8cbc-48d6-9cc6-06c01826d25f" containerName="istio-proxy"
Oct 30 21:03:24.620721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620696    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34e95215-8cbc-48d6-9cc6-06c01826d25f" containerName="istio-proxy"
Oct 30 21:03:24.620721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620709    6048 cpu_manager.go:414] "containerMap: removing container" podUID="2e1a4e79-7954-407f-b9a7-fa5163bb099a" containerName="payload-processing"
Oct 30 21:03:24.620721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620714    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e1a4e79-7954-407f-b9a7-fa5163bb099a" containerName="payload-processing"
Oct 30 21:03:24.620721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620721    6048 cpu_manager.go:414] "containerMap: removing container" podUID="649feb12-6ac4-41a1-8632-e0faa768d083" containerName="istio-proxy"
Oct 30 21:03:24.620721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620726    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="649feb12-6ac4-41a1-8632-e0faa768d083" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620733    6048 cpu_manager.go:414] "containerMap: removing container" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620738    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620744    6048 cpu_manager.go:414] "containerMap: removing container" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620750    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620758    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620762    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620769    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620773    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620782    6048 cpu_manager.go:414] "containerMap: removing container" podUID="7de72904-4846-4ae7-baa4-07e587cb6199" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620787    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7de72904-4846-4ae7-baa4-07e587cb6199" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620796    6048 cpu_manager.go:414] "containerMap: removing container" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620800    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620808    6048 cpu_manager.go:414] "containerMap: removing container" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620813    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620819    6048 cpu_manager.go:414] "containerMap: removing container" podUID="bb223380-c1c3-4a02-8cc0-5021e8d258af" containerName="payload-pre-processing"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620823    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb223380-c1c3-4a02-8cc0-5021e8d258af" containerName="payload-pre-processing"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620831    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620836    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620845    6048 cpu_manager.go:414] "containerMap: removing container" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620849    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620856    6048 cpu_manager.go:414] "containerMap: removing container" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620861    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620868    6048 cpu_manager.go:414] "containerMap: removing container" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620873    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620880    6048 cpu_manager.go:414] "containerMap: removing container" podUID="e65fd2ab-db13-4873-b1f1-75c03dbb0891" containerName="revoke-keys"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620885    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e65fd2ab-db13-4873-b1f1-75c03dbb0891" containerName="revoke-keys"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620892    6048 cpu_manager.go:414] "containerMap: removing container" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620897    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620906    6048 cpu_manager.go:414] "containerMap: removing container" podUID="c59ef562-dd6a-4eae-bdb3-0f5657cd22ac" containerName="revoke-keys"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620911    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c59ef562-dd6a-4eae-bdb3-0f5657cd22ac" containerName="revoke-keys"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620918    6048 cpu_manager.go:414] "containerMap: removing container" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620923    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620930    6048 cpu_manager.go:414] "containerMap: removing container" podUID="ffcfe6ad-d38d-445d-8dd3-98be89d45ac9" containerName="payload-processing"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620934    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ffcfe6ad-d38d-445d-8dd3-98be89d45ac9" containerName="payload-processing"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620941    6048 cpu_manager.go:414] "containerMap: removing container" podUID="4008794a-54c1-42cb-b1b5-0b693853c487" containerName="revoke-keys"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620946    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4008794a-54c1-42cb-b1b5-0b693853c487" containerName="revoke-keys"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620954    6048 cpu_manager.go:414] "containerMap: removing container" podUID="ce7325fd-eccd-4b9e-b1ef-770f781db58b" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620959    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce7325fd-eccd-4b9e-b1ef-770f781db58b" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620967    6048 cpu_manager.go:414] "containerMap: removing container" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620971    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620979    6048 cpu_manager.go:414] "containerMap: removing container" podUID="b4893641-f5a3-44b3-823b-8a3c2d6fa548" containerName="payload-pre-processing"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620984    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4893641-f5a3-44b3-823b-8a3c2d6fa548" containerName="payload-pre-processing"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620990    6048 cpu_manager.go:414] "containerMap: removing container" podUID="ea40cb7a-b1a7-480d-99b8-88c825bc3448" containerName="maas-api"
Oct 30 21:03:24.620977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.620994    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea40cb7a-b1a7-480d-99b8-88c825bc3448" containerName="maas-api"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621007    6048 cpu_manager.go:414] "containerMap: removing container" podUID="24721fde-f300-468a-8621-e2e98ce6a888" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621011    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24721fde-f300-468a-8621-e2e98ce6a888" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621098    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce7325fd-eccd-4b9e-b1ef-770f781db58b" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621105    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e1d4ca7-3f79-4a4d-8661-8aed3d850449" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621114    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4893641-f5a3-44b3-823b-8a3c2d6fa548" containerName="payload-pre-processing"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621121    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea40cb7a-b1a7-480d-99b8-88c825bc3448" containerName="maas-api"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621129    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621135    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="24721fde-f300-468a-8621-e2e98ce6a888" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621143    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="34e95215-8cbc-48d6-9cc6-06c01826d25f" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621151    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e1a4e79-7954-407f-b9a7-fa5163bb099a" containerName="payload-processing"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621156    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="649feb12-6ac4-41a1-8632-e0faa768d083" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621161    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="2a61036c-ce15-46cb-a653-fabd401a29d3" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621167    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621172    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621176    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a13da80e-3191-468e-892f-db0a84b06b3c" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621182    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="7de72904-4846-4ae7-baa4-07e587cb6199" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621187    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0dadee7-bff2-46b1-bcda-3d3153699577" containerName="main"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621191    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="0bef2832-cf0e-4334-9d10-0d123781cdb4" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621197    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb223380-c1c3-4a02-8cc0-5021e8d258af" containerName="payload-pre-processing"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621203    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a37eeba9-e92a-4cf2-a577-ddb2cacf4b0c" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621209    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="97c16fe5-4533-4461-b707-875be418fce3" containerName="main"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621215    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="9703dc85-1cd0-44c8-881a-1a84c54961ad" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621219    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="82c15701-2c8e-4ec6-909b-e6cb642b42f4" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621224    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="e65fd2ab-db13-4873-b1f1-75c03dbb0891" containerName="revoke-keys"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621228    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="e7ba0657-f0de-4706-8917-56d3c9d53cad" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621233    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="c59ef562-dd6a-4eae-bdb3-0f5657cd22ac" containerName="revoke-keys"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621238    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5726e1a-1ae0-43b1-a6bb-386850c9ef8a" containerName="istio-proxy"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621243    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="ffcfe6ad-d38d-445d-8dd3-98be89d45ac9" containerName="payload-processing"
Oct 30 21:03:24.622269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.621248    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="4008794a-54c1-42cb-b1b5-0b693853c487" containerName="revoke-keys"
Oct 30 21:03:24.626425 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.626404    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:24.633753 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.633728    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:03:24.633881 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.633763    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:03:24.639268 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.639244    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"]
Oct 30 21:03:24.677192 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.677164    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:03:24.677365 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.677219    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:03:24.745453 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.745416    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4\" (UID: \"cae504ec-7644-4888-941b-db1dc6e2ade4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:24.745593 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.745486    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4\" (UID: \"cae504ec-7644-4888-941b-db1dc6e2ade4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:24.745593 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.745583    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzrzd\" (UniqueName: \"kubernetes.io/projected/cae504ec-7644-4888-941b-db1dc6e2ade4-kube-api-access-xzrzd\") pod \"maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4\" (UID: \"cae504ec-7644-4888-941b-db1dc6e2ade4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:24.846706 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.846675    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzrzd\" (UniqueName: \"kubernetes.io/projected/cae504ec-7644-4888-941b-db1dc6e2ade4-kube-api-access-xzrzd\") pod \"maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4\" (UID: \"cae504ec-7644-4888-941b-db1dc6e2ade4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:24.846868 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.846766    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4\" (UID: \"cae504ec-7644-4888-941b-db1dc6e2ade4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:24.846868 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.846806    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4\" (UID: \"cae504ec-7644-4888-941b-db1dc6e2ade4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:24.847415 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.847390    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4\" (UID: \"cae504ec-7644-4888-941b-db1dc6e2ade4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:24.849145 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.849120    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4\" (UID: \"cae504ec-7644-4888-941b-db1dc6e2ade4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:24.859041 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.859006    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzrzd\" (UniqueName: \"kubernetes.io/projected/cae504ec-7644-4888-941b-db1dc6e2ade4-kube-api-access-xzrzd\") pod \"maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4\" (UID: \"cae504ec-7644-4888-941b-db1dc6e2ade4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:24.940599 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:24.940526    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:25.248571 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:25.248540    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"]
Oct 30 21:03:25.250013 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:03:25.249982    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae504ec_7644_4888_941b_db1dc6e2ade4.slice/crio-189aa4c80b23d1ac549469eeda13b8ee6b93dd10c17edad80d56ef83e9e88f18 WatchSource:0}: Error finding container 189aa4c80b23d1ac549469eeda13b8ee6b93dd10c17edad80d56ef83e9e88f18: Status 404 returned error can't find the container with id 189aa4c80b23d1ac549469eeda13b8ee6b93dd10c17edad80d56ef83e9e88f18
Oct 30 21:03:25.595628 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:25.595589    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4" event={"ID":"cae504ec-7644-4888-941b-db1dc6e2ade4","Type":"ContainerStarted","Data":"994899eaae23f26cee847b95bf8e37267aa2d28a3e9560aa0b67e2740d004af6"}
Oct 30 21:03:25.595786 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:25.595665    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4" event={"ID":"cae504ec-7644-4888-941b-db1dc6e2ade4","Type":"ContainerStarted","Data":"189aa4c80b23d1ac549469eeda13b8ee6b93dd10c17edad80d56ef83e9e88f18"}
Oct 30 21:03:25.624555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:25.624100    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4" podStartSLOduration=1.624082564 podStartE2EDuration="1.624082564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:03:25.621427067 +0000 UTC m=+1416.480163360" watchObservedRunningTime="2026-10-30 21:03:25.624082564 +0000 UTC m=+1416.482818857"
Oct 30 21:03:26.604258 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:26.604218    6048 generic.go:356] "Generic (PLEG): container finished" podID="cae504ec-7644-4888-941b-db1dc6e2ade4" containerID="994899eaae23f26cee847b95bf8e37267aa2d28a3e9560aa0b67e2740d004af6" exitCode=0
Oct 30 21:03:26.604457 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:26.604302    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4" event={"ID":"cae504ec-7644-4888-941b-db1dc6e2ade4","Type":"ContainerDied","Data":"994899eaae23f26cee847b95bf8e37267aa2d28a3e9560aa0b67e2740d004af6"}
Oct 30 21:03:27.769310 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:27.769284    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:27.783417 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:27.783392    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-xks-ca\") pod \"cae504ec-7644-4888-941b-db1dc6e2ade4\" (UID: \"cae504ec-7644-4888-941b-db1dc6e2ade4\") "
Oct 30 21:03:27.783556 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:27.783488    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-openshift-ca\") pod \"cae504ec-7644-4888-941b-db1dc6e2ade4\" (UID: \"cae504ec-7644-4888-941b-db1dc6e2ade4\") "
Oct 30 21:03:27.783633 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:27.783614    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cae504ec-7644-4888-941b-db1dc6e2ade4-kube-api-access-xzrzd\" (UniqueName: \"kubernetes.io/projected/cae504ec-7644-4888-941b-db1dc6e2ade4-kube-api-access-xzrzd\") pod \"cae504ec-7644-4888-941b-db1dc6e2ade4\" (UID: \"cae504ec-7644-4888-941b-db1dc6e2ade4\") "
Oct 30 21:03:27.783794 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:27.783769    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-openshift-ca" pod "cae504ec-7644-4888-941b-db1dc6e2ade4" (UID: "cae504ec-7644-4888-941b-db1dc6e2ade4"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:27.784089 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:27.784071    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:27.785519 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:27.785491    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-xks-ca" pod "cae504ec-7644-4888-941b-db1dc6e2ade4" (UID: "cae504ec-7644-4888-941b-db1dc6e2ade4"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:27.785673 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:27.785646    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cae504ec-7644-4888-941b-db1dc6e2ade4-kube-api-access-xzrzd" pod "cae504ec-7644-4888-941b-db1dc6e2ade4" (UID: "cae504ec-7644-4888-941b-db1dc6e2ade4"). InnerVolumeSpecName "kube-api-access-xzrzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:27.885413 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:27.885327    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/cae504ec-7644-4888-941b-db1dc6e2ade4-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:27.885413 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:27.885356    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzrzd\" (UniqueName: \"kubernetes.io/projected/cae504ec-7644-4888-941b-db1dc6e2ade4-kube-api-access-xzrzd\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:28.619479 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:28.619450    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"
Oct 30 21:03:28.619479 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:28.619467    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4" event={"ID":"cae504ec-7644-4888-941b-db1dc6e2ade4","Type":"ContainerDied","Data":"189aa4c80b23d1ac549469eeda13b8ee6b93dd10c17edad80d56ef83e9e88f18"}
Oct 30 21:03:28.619754 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:28.619521    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="189aa4c80b23d1ac549469eeda13b8ee6b93dd10c17edad80d56ef83e9e88f18"
Oct 30 21:03:29.410183 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:29.410141    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"]
Oct 30 21:03:35.465055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.464996    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"]
Oct 30 21:03:35.465666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.465509    6048 cpu_manager.go:414] "containerMap: removing container" podUID="cae504ec-7644-4888-941b-db1dc6e2ade4" containerName="revoke-keys"
Oct 30 21:03:35.465666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.465522    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cae504ec-7644-4888-941b-db1dc6e2ade4" containerName="revoke-keys"
Oct 30 21:03:35.465666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.465545    6048 cpu_manager.go:414] "containerMap: removing container" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy"
Oct 30 21:03:35.465666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.465551    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy"
Oct 30 21:03:35.465666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.465566    6048 cpu_manager.go:414] "containerMap: removing container" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy"
Oct 30 21:03:35.465666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.465571    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy"
Oct 30 21:03:35.465666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.465643    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="cae504ec-7644-4888-941b-db1dc6e2ade4" containerName="revoke-keys"
Oct 30 21:03:35.465666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.465652    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="81a9336f-fae4-47ca-bf38-e894ccde4f49" containerName="istio-proxy"
Oct 30 21:03:35.465666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.465662    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="080b8378-c19b-4464-903c-a0e47a458775" containerName="istio-proxy"
Oct 30 21:03:35.471765 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.471717    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:35.482282 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.482254    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:03:35.482509 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.482489    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:03:35.482613 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.482532    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:03:35.485224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.485204    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:03:35.494868 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.494842    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"]
Oct 30 21:03:35.577234 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.577201    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5d765870-lr9r2\" (UID: \"979f3391-e235-43e7-9521-b40b1e831c32\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:35.577403 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.577337    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5d765870-lr9r2\" (UID: \"979f3391-e235-43e7-9521-b40b1e831c32\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:35.577466 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.577445    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5mrp\" (UniqueName: \"kubernetes.io/projected/979f3391-e235-43e7-9521-b40b1e831c32-kube-api-access-m5mrp\") pod \"maas-api-revoke-sub-5d765870-lr9r2\" (UID: \"979f3391-e235-43e7-9521-b40b1e831c32\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:35.678530 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.678485    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5mrp\" (UniqueName: \"kubernetes.io/projected/979f3391-e235-43e7-9521-b40b1e831c32-kube-api-access-m5mrp\") pod \"maas-api-revoke-sub-5d765870-lr9r2\" (UID: \"979f3391-e235-43e7-9521-b40b1e831c32\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:35.678716 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.678596    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5d765870-lr9r2\" (UID: \"979f3391-e235-43e7-9521-b40b1e831c32\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:35.678769 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.678736    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5d765870-lr9r2\" (UID: \"979f3391-e235-43e7-9521-b40b1e831c32\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:35.679374 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.679347    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5d765870-lr9r2\" (UID: \"979f3391-e235-43e7-9521-b40b1e831c32\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:35.680949 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.680927    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5d765870-lr9r2\" (UID: \"979f3391-e235-43e7-9521-b40b1e831c32\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:35.691817 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.691795    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5mrp\" (UniqueName: \"kubernetes.io/projected/979f3391-e235-43e7-9521-b40b1e831c32-kube-api-access-m5mrp\") pod \"maas-api-revoke-sub-5d765870-lr9r2\" (UID: \"979f3391-e235-43e7-9521-b40b1e831c32\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:35.786148 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:35.786073    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:36.068475 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:36.068441    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"]
Oct 30 21:03:36.069910 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:03:36.069882    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979f3391_e235_43e7_9521_b40b1e831c32.slice/crio-5767665f4e5414ca1b9a218eba376b5fe3ce74476aab1301afdf78eeb21c3419 WatchSource:0}: Error finding container 5767665f4e5414ca1b9a218eba376b5fe3ce74476aab1301afdf78eeb21c3419: Status 404 returned error can't find the container with id 5767665f4e5414ca1b9a218eba376b5fe3ce74476aab1301afdf78eeb21c3419
Oct 30 21:03:36.690965 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:36.690873    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2" event={"ID":"979f3391-e235-43e7-9521-b40b1e831c32","Type":"ContainerStarted","Data":"3e444f52ef9caa93a6f7b34e8d09f2495d63a87a041d9bdf15fd415bcc10a5b9"}
Oct 30 21:03:36.690965 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:36.690932    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2" event={"ID":"979f3391-e235-43e7-9521-b40b1e831c32","Type":"ContainerStarted","Data":"5767665f4e5414ca1b9a218eba376b5fe3ce74476aab1301afdf78eeb21c3419"}
Oct 30 21:03:36.710470 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:36.710423    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2" podStartSLOduration=1.71040942 podStartE2EDuration="1.71040942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:03:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:03:36.708671272 +0000 UTC m=+1427.567407569" watchObservedRunningTime="2026-10-30 21:03:36.71040942 +0000 UTC m=+1427.569145714"
Oct 30 21:03:37.699055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:37.698949    6048 generic.go:356] "Generic (PLEG): container finished" podID="979f3391-e235-43e7-9521-b40b1e831c32" containerID="3e444f52ef9caa93a6f7b34e8d09f2495d63a87a041d9bdf15fd415bcc10a5b9" exitCode=0
Oct 30 21:03:37.699055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:37.699005    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2" event={"ID":"979f3391-e235-43e7-9521-b40b1e831c32","Type":"ContainerDied","Data":"3e444f52ef9caa93a6f7b34e8d09f2495d63a87a041d9bdf15fd415bcc10a5b9"}
Oct 30 21:03:38.868684 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:38.868655    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:38.917433 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:38.917399    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-openshift-ca\") pod \"979f3391-e235-43e7-9521-b40b1e831c32\" (UID: \"979f3391-e235-43e7-9521-b40b1e831c32\") "
Oct 30 21:03:38.917612 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:38.917470    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-xks-ca\") pod \"979f3391-e235-43e7-9521-b40b1e831c32\" (UID: \"979f3391-e235-43e7-9521-b40b1e831c32\") "
Oct 30 21:03:38.917612 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:38.917500    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/979f3391-e235-43e7-9521-b40b1e831c32-kube-api-access-m5mrp\" (UniqueName: \"kubernetes.io/projected/979f3391-e235-43e7-9521-b40b1e831c32-kube-api-access-m5mrp\") pod \"979f3391-e235-43e7-9521-b40b1e831c32\" (UID: \"979f3391-e235-43e7-9521-b40b1e831c32\") "
Oct 30 21:03:38.917900 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:38.917870    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-openshift-ca" pod "979f3391-e235-43e7-9521-b40b1e831c32" (UID: "979f3391-e235-43e7-9521-b40b1e831c32"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:38.919805 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:38.919774    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-xks-ca" pod "979f3391-e235-43e7-9521-b40b1e831c32" (UID: "979f3391-e235-43e7-9521-b40b1e831c32"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:38.919805 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:38.919795    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/979f3391-e235-43e7-9521-b40b1e831c32-kube-api-access-m5mrp" pod "979f3391-e235-43e7-9521-b40b1e831c32" (UID: "979f3391-e235-43e7-9521-b40b1e831c32"). InnerVolumeSpecName "kube-api-access-m5mrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:39.018705 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:39.018615    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:39.018705 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:39.018654    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5mrp\" (UniqueName: \"kubernetes.io/projected/979f3391-e235-43e7-9521-b40b1e831c32-kube-api-access-m5mrp\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:39.018705 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:39.018669    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/979f3391-e235-43e7-9521-b40b1e831c32-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:39.722524 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:39.722492    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"
Oct 30 21:03:39.722713 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:39.722525    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2" event={"ID":"979f3391-e235-43e7-9521-b40b1e831c32","Type":"ContainerDied","Data":"5767665f4e5414ca1b9a218eba376b5fe3ce74476aab1301afdf78eeb21c3419"}
Oct 30 21:03:39.722713 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:39.722609    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5767665f4e5414ca1b9a218eba376b5fe3ce74476aab1301afdf78eeb21c3419"
Oct 30 21:03:44.430568 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.430529    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main" containerID="cri-o://5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e" gracePeriod=45
Oct 30 21:03:44.707522 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.707500    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:03:44.760751 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.760714    6048 generic.go:356] "Generic (PLEG): container finished" podID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerID="5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e" exitCode=0
Oct 30 21:03:44.760968 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.760948    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" event={"ID":"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27","Type":"ContainerDied","Data":"5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e"}
Oct 30 21:03:44.761052 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.760994    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs" event={"ID":"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27","Type":"ContainerDied","Data":"43a72d75c7b330de52f1383eee14d5cea7c2ddd95a82980e0448e2866ef21dfa"}
Oct 30 21:03:44.761094 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.761018    6048 scope.go:122] "RemoveContainer" containerID="5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e"
Oct 30 21:03:44.761234 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.761218    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"
Oct 30 21:03:44.774248 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.774212    6048 scope.go:122] "RemoveContainer" containerID="5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e"
Oct 30 21:03:44.774614 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:03:44.774593    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e\": container with ID starting with 5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e not found: ID does not exist" containerID="5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e"
Oct 30 21:03:44.774704 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.774623    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e"} err="failed to get container status \"5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e\": rpc error: code = NotFound desc = could not find container \"5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e\": container with ID starting with 5c279bf3ccfd5b653539fb33075697effd80a3a3f6818316364b3689bfab8e7e not found: ID does not exist"
Oct 30 21:03:44.781711 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.781678    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-dshm\") pod \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") "
Oct 30 21:03:44.781838 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.781746    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tls-certs\" (UniqueName: \"kubernetes.io/secret/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tls-certs\") pod \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") "
Oct 30 21:03:44.781838 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.781826    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-model-cache\") pod \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") "
Oct 30 21:03:44.781954 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.781850    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-home\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-home\") pod \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") "
Oct 30 21:03:44.782014 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.781969    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tmp-dir\") pod \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") "
Oct 30 21:03:44.782014 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.782007    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-kube-api-access-bzk4v\" (UniqueName: \"kubernetes.io/projected/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-kube-api-access-bzk4v\") pod \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\" (UID: \"1117c12d-3aba-40d8-a4b0-0c7aa9a19d27\") "
Oct 30 21:03:44.782464 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.782209    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-home" pod "1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" (UID: "1117c12d-3aba-40d8-a4b0-0c7aa9a19d27"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:44.782464 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.782299    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tmp-dir" pod "1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" (UID: "1117c12d-3aba-40d8-a4b0-0c7aa9a19d27"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:44.782622 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.782539    6048 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tmp-dir\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:44.782622 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.782559    6048 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-home\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:44.782735 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.782618    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-model-cache" pod "1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" (UID: "1117c12d-3aba-40d8-a4b0-0c7aa9a19d27"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:44.785502 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.785441    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tls-certs" pod "1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" (UID: "1117c12d-3aba-40d8-a4b0-0c7aa9a19d27"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:44.785502 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.785455    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-kube-api-access-bzk4v" pod "1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" (UID: "1117c12d-3aba-40d8-a4b0-0c7aa9a19d27"). InnerVolumeSpecName "kube-api-access-bzk4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:44.785652 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.785523    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-dshm" pod "1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" (UID: "1117c12d-3aba-40d8-a4b0-0c7aa9a19d27"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:03:44.883906 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.883871    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzk4v\" (UniqueName: \"kubernetes.io/projected/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-kube-api-access-bzk4v\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:44.883906 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.883902    6048 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-dshm\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:44.883906 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.883912    6048 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-tls-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:44.884186 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:44.883921    6048 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27-model-cache\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:03:45.085707 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:45.085675    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"]
Oct 30 21:03:45.090214 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:45.090186    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-c4b379/distinct-w1-c4b379-kserve-84b889547b-tmfzs"]
Oct 30 21:03:45.261658 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:45.260332    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" path="/var/lib/kubelet/pods/1117c12d-3aba-40d8-a4b0-0c7aa9a19d27/volumes"
Oct 30 21:03:46.801399 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:03:46.801353    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:03:50.715496 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:50.715455    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"]
Oct 30 21:03:50.718414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:50.718390    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-c4b379-wzzx4"]
Oct 30 21:03:51.259260 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:51.259227    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cae504ec-7644-4888-941b-db1dc6e2ade4" path="/var/lib/kubelet/pods/cae504ec-7644-4888-941b-db1dc6e2ade4/volumes"
Oct 30 21:03:57.635166 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:57.635097    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"]
Oct 30 21:03:57.636005 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:57.635396    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" podUID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" containerName="istio-proxy" containerID="cri-o://8dd1683fb40e6ae6193bb37ca0dc1632efb4c7370f6229442d5ff9d208ea76fe" gracePeriod=30
Oct 30 21:03:57.641704 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:57.641674    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"]
Oct 30 21:03:57.642116 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:57.642064    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" podUID="c2a3a351-0d0c-44f7-9807-c4e947600c12" containerName="istio-proxy" containerID="cri-o://242de62556af269f9b23632e2dc3f29ea22e8d6920e53fa941d141b4ac4d9783" gracePeriod=30
Oct 30 21:03:57.655412 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:57.655371    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"]
Oct 30 21:03:57.655613 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:03:57.655589    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy" containerID="cri-o://7c8a4e4284eb2b7eec021f31bcdf4f6c191c5d5a31878025ff55bb0852ddf818" gracePeriod=30
Oct 30 21:04:03.040014 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:03.039669    6048 generic.go:356] "Generic (PLEG): container finished" podID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerID="7c8a4e4284eb2b7eec021f31bcdf4f6c191c5d5a31878025ff55bb0852ddf818" exitCode=0
Oct 30 21:04:03.040014 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:03.039861    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" event={"ID":"c77a5d82-8c9e-4204-8c32-ef6585023df6","Type":"ContainerDied","Data":"7c8a4e4284eb2b7eec021f31bcdf4f6c191c5d5a31878025ff55bb0852ddf818"}
Oct 30 21:04:03.046076 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:03.042728    6048 generic.go:356] "Generic (PLEG): container finished" podID="c2a3a351-0d0c-44f7-9807-c4e947600c12" containerID="242de62556af269f9b23632e2dc3f29ea22e8d6920e53fa941d141b4ac4d9783" exitCode=0
Oct 30 21:04:03.046076 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:03.042807    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" event={"ID":"c2a3a351-0d0c-44f7-9807-c4e947600c12","Type":"ContainerDied","Data":"242de62556af269f9b23632e2dc3f29ea22e8d6920e53fa941d141b4ac4d9783"}
Oct 30 21:04:03.060490 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:03.060280    6048 generic.go:356] "Generic (PLEG): container finished" podID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" containerID="8dd1683fb40e6ae6193bb37ca0dc1632efb4c7370f6229442d5ff9d208ea76fe" exitCode=0
Oct 30 21:04:03.060490 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:03.060410    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" event={"ID":"172e9bb0-da74-45a8-9bdf-b40f49a91b2b","Type":"ContainerDied","Data":"8dd1683fb40e6ae6193bb37ca0dc1632efb4c7370f6229442d5ff9d208ea76fe"}
Oct 30 21:04:03.290715 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:03.290279    6048 patch_prober.go:29] interesting pod/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:04:03.290715 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:03.290344    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 30 21:04:04.011157 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.008683    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 21:04:04.124047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.104711    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-certs\") pod \"c77a5d82-8c9e-4204-8c32-ef6585023df6\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") "
Oct 30 21:04:04.124047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.104786    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-data\") pod \"c77a5d82-8c9e-4204-8c32-ef6585023df6\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") "
Oct 30 21:04:04.124047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.104817    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-token\" (UniqueName: \"kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-token\") pod \"c77a5d82-8c9e-4204-8c32-ef6585023df6\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") "
Oct 30 21:04:04.124047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.104847    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-podinfo\") pod \"c77a5d82-8c9e-4204-8c32-ef6585023df6\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") "
Oct 30 21:04:04.124047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.104965    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c77a5d82-8c9e-4204-8c32-ef6585023df6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c77a5d82-8c9e-4204-8c32-ef6585023df6-istiod-ca-cert\") pod \"c77a5d82-8c9e-4204-8c32-ef6585023df6\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") "
Oct 30 21:04:04.124047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.105003    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-envoy\") pod \"c77a5d82-8c9e-4204-8c32-ef6585023df6\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") "
Oct 30 21:04:04.128814 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.127492    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-socket\") pod \"c77a5d82-8c9e-4204-8c32-ef6585023df6\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") "
Oct 30 21:04:04.128814 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.127570    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-credential-socket\") pod \"c77a5d82-8c9e-4204-8c32-ef6585023df6\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") "
Oct 30 21:04:04.128814 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.127613    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-kube-api-access-72gxg\" (UniqueName: \"kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-kube-api-access-72gxg\") pod \"c77a5d82-8c9e-4204-8c32-ef6585023df6\" (UID: \"c77a5d82-8c9e-4204-8c32-ef6585023df6\") "
Oct 30 21:04:04.135839 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.129179    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gp2wl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:04:04.135839 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.129236    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:04:04.157841 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.152204    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-t97cq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:04:04.157841 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.152274    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:04:04.157841 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.157359    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-data" pod "c77a5d82-8c9e-4204-8c32-ef6585023df6" (UID: "c77a5d82-8c9e-4204-8c32-ef6585023df6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.158126 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.158095    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-socket" pod "c77a5d82-8c9e-4204-8c32-ef6585023df6" (UID: "c77a5d82-8c9e-4204-8c32-ef6585023df6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.158555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.158344    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-certs" pod "c77a5d82-8c9e-4204-8c32-ef6585023df6" (UID: "c77a5d82-8c9e-4204-8c32-ef6585023df6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.162331 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.158821    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77a5d82-8c9e-4204-8c32-ef6585023df6-istiod-ca-cert" pod "c77a5d82-8c9e-4204-8c32-ef6585023df6" (UID: "c77a5d82-8c9e-4204-8c32-ef6585023df6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:04:04.167538 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.166097    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-credential-socket" pod "c77a5d82-8c9e-4204-8c32-ef6585023df6" (UID: "c77a5d82-8c9e-4204-8c32-ef6585023df6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.178646 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.169902    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck" event={"ID":"c77a5d82-8c9e-4204-8c32-ef6585023df6","Type":"ContainerDied","Data":"040dacab8e940b4a92dd3cbccf2e6d2d1c5a2b22cd2256c063e673780f2261f3"}
Oct 30 21:04:04.178646 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.169973    6048 scope.go:122] "RemoveContainer" containerID="7c8a4e4284eb2b7eec021f31bcdf4f6c191c5d5a31878025ff55bb0852ddf818"
Oct 30 21:04:04.178646 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.170198    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"
Oct 30 21:04:04.194132 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.194016    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-podinfo" pod "c77a5d82-8c9e-4204-8c32-ef6585023df6" (UID: "c77a5d82-8c9e-4204-8c32-ef6585023df6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:04:04.194457 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.194406    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-kube-api-access-72gxg" pod "c77a5d82-8c9e-4204-8c32-ef6585023df6" (UID: "c77a5d82-8c9e-4204-8c32-ef6585023df6"). InnerVolumeSpecName "kube-api-access-72gxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:04.217713 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.217404    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-envoy" pod "c77a5d82-8c9e-4204-8c32-ef6585023df6" (UID: "c77a5d82-8c9e-4204-8c32-ef6585023df6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.218383 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.218338    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-token" pod "c77a5d82-8c9e-4204-8c32-ef6585023df6" (UID: "c77a5d82-8c9e-4204-8c32-ef6585023df6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:04.237980 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.237807    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.237980 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.237844    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72gxg\" (UniqueName: \"kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-kube-api-access-72gxg\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.237980 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.237860    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.237980 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.237874    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.237980 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.237889    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.237980 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.237903    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.237980 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.237917    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c77a5d82-8c9e-4204-8c32-ef6585023df6-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.237980 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.237931    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.237980 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.237946    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c77a5d82-8c9e-4204-8c32-ef6585023df6-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.360428 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.360400    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:04:04.362585 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.362551    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:04:04.440538 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.440496    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-kube-api-access-zjchr\" (UniqueName: \"kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-kube-api-access-zjchr\") pod \"c2a3a351-0d0c-44f7-9807-c4e947600c12\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") "
Oct 30 21:04:04.440725 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.440555    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-certs\") pod \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") "
Oct 30 21:04:04.440725 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.440589    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-podinfo\") pod \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") "
Oct 30 21:04:04.440725 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.440668    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-kube-api-access-h4kg4\" (UniqueName: \"kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-kube-api-access-h4kg4\") pod \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") "
Oct 30 21:04:04.440725 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.440711    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-socket\") pod \"c2a3a351-0d0c-44f7-9807-c4e947600c12\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") "
Oct 30 21:04:04.440978 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.440760    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-data\") pod \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") "
Oct 30 21:04:04.440978 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.440827    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-envoy\") pod \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") "
Oct 30 21:04:04.440978 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.440859    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-podinfo\") pod \"c2a3a351-0d0c-44f7-9807-c4e947600c12\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") "
Oct 30 21:04:04.440978 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.440877    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-certs" pod "172e9bb0-da74-45a8-9bdf-b40f49a91b2b" (UID: "172e9bb0-da74-45a8-9bdf-b40f49a91b2b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.440978 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.440903    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-token\" (UniqueName: \"kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-token\") pod \"c2a3a351-0d0c-44f7-9807-c4e947600c12\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") "
Oct 30 21:04:04.440978 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.440946    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-data\") pod \"c2a3a351-0d0c-44f7-9807-c4e947600c12\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") "
Oct 30 21:04:04.441401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.440990    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istiod-ca-cert\") pod \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") "
Oct 30 21:04:04.441401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441038    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-envoy\") pod \"c2a3a351-0d0c-44f7-9807-c4e947600c12\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") "
Oct 30 21:04:04.441401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441080    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-token\" (UniqueName: \"kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-token\") pod \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") "
Oct 30 21:04:04.441401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441105    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-data" pod "172e9bb0-da74-45a8-9bdf-b40f49a91b2b" (UID: "172e9bb0-da74-45a8-9bdf-b40f49a91b2b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.441401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441123    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-credential-socket\") pod \"c2a3a351-0d0c-44f7-9807-c4e947600c12\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") "
Oct 30 21:04:04.441401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441177    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-certs\") pod \"c2a3a351-0d0c-44f7-9807-c4e947600c12\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") "
Oct 30 21:04:04.441401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441294    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-socket" pod "c2a3a351-0d0c-44f7-9807-c4e947600c12" (UID: "c2a3a351-0d0c-44f7-9807-c4e947600c12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.441401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441245    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-socket\") pod \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") "
Oct 30 21:04:04.441401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441382    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c2a3a351-0d0c-44f7-9807-c4e947600c12-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a3a351-0d0c-44f7-9807-c4e947600c12-istiod-ca-cert\") pod \"c2a3a351-0d0c-44f7-9807-c4e947600c12\" (UID: \"c2a3a351-0d0c-44f7-9807-c4e947600c12\") "
Oct 30 21:04:04.441915 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441427    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-credential-socket\") pod \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\" (UID: \"172e9bb0-da74-45a8-9bdf-b40f49a91b2b\") "
Oct 30 21:04:04.441915 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441523    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-socket" pod "172e9bb0-da74-45a8-9bdf-b40f49a91b2b" (UID: "172e9bb0-da74-45a8-9bdf-b40f49a91b2b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.441915 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441726    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-data" pod "c2a3a351-0d0c-44f7-9807-c4e947600c12" (UID: "c2a3a351-0d0c-44f7-9807-c4e947600c12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.442277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441923    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.442277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441944    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.442277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441956    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-credential-socket" pod "172e9bb0-da74-45a8-9bdf-b40f49a91b2b" (UID: "172e9bb0-da74-45a8-9bdf-b40f49a91b2b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.442277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441960    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.442277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.442002    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.442277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.442055    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.442277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.441971    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2a3a351-0d0c-44f7-9807-c4e947600c12-istiod-ca-cert" pod "c2a3a351-0d0c-44f7-9807-c4e947600c12" (UID: "c2a3a351-0d0c-44f7-9807-c4e947600c12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:04:04.442906 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.442879    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istiod-ca-cert" pod "172e9bb0-da74-45a8-9bdf-b40f49a91b2b" (UID: "172e9bb0-da74-45a8-9bdf-b40f49a91b2b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:04:04.443181 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.443156    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-credential-socket" pod "c2a3a351-0d0c-44f7-9807-c4e947600c12" (UID: "c2a3a351-0d0c-44f7-9807-c4e947600c12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.443613 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.443371    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-certs" pod "c2a3a351-0d0c-44f7-9807-c4e947600c12" (UID: "c2a3a351-0d0c-44f7-9807-c4e947600c12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.445521 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.445493    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-envoy" pod "172e9bb0-da74-45a8-9bdf-b40f49a91b2b" (UID: "172e9bb0-da74-45a8-9bdf-b40f49a91b2b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.445521 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.445507    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-kube-api-access-h4kg4" pod "172e9bb0-da74-45a8-9bdf-b40f49a91b2b" (UID: "172e9bb0-da74-45a8-9bdf-b40f49a91b2b"). InnerVolumeSpecName "kube-api-access-h4kg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:04.445686 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.445535    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-token" pod "172e9bb0-da74-45a8-9bdf-b40f49a91b2b" (UID: "172e9bb0-da74-45a8-9bdf-b40f49a91b2b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:04.445686 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.445639    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-podinfo" pod "172e9bb0-da74-45a8-9bdf-b40f49a91b2b" (UID: "172e9bb0-da74-45a8-9bdf-b40f49a91b2b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:04:04.445808 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.445716    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-podinfo" pod "c2a3a351-0d0c-44f7-9807-c4e947600c12" (UID: "c2a3a351-0d0c-44f7-9807-c4e947600c12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:04:04.446263 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.446234    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-envoy" pod "c2a3a351-0d0c-44f7-9807-c4e947600c12" (UID: "c2a3a351-0d0c-44f7-9807-c4e947600c12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:04.446600 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.446575    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-kube-api-access-zjchr" pod "c2a3a351-0d0c-44f7-9807-c4e947600c12" (UID: "c2a3a351-0d0c-44f7-9807-c4e947600c12"). InnerVolumeSpecName "kube-api-access-zjchr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:04.447441 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.447417    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-token" pod "c2a3a351-0d0c-44f7-9807-c4e947600c12" (UID: "c2a3a351-0d0c-44f7-9807-c4e947600c12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:04.494890 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.494861    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"]
Oct 30 21:04:04.499237 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.499208    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-twxck"]
Oct 30 21:04:04.543144 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543111    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.543144 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543142    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4kg4\" (UniqueName: \"kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-kube-api-access-h4kg4\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.543359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543157    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.543359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543169    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.543359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543182    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.543359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543193    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.543359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543205    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.543359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543216    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.543359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543228    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.543359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543239    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2a3a351-0d0c-44f7-9807-c4e947600c12-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.543359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543252    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2a3a351-0d0c-44f7-9807-c4e947600c12-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.543359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543267    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/172e9bb0-da74-45a8-9bdf-b40f49a91b2b-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:04.543359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:04.543280    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjchr\" (UniqueName: \"kubernetes.io/projected/c2a3a351-0d0c-44f7-9807-c4e947600c12-kube-api-access-zjchr\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:05.176838 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.176807    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk" event={"ID":"c2a3a351-0d0c-44f7-9807-c4e947600c12","Type":"ContainerDied","Data":"d80ed90ed3412f79e1c8f3a2b2dda17043276211a3024845bc143f417d9ca31e"}
Oct 30 21:04:05.177304 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.176873    6048 scope.go:122] "RemoveContainer" containerID="242de62556af269f9b23632e2dc3f29ea22e8d6920e53fa941d141b4ac4d9783"
Oct 30 21:04:05.177304 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.176813    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"
Oct 30 21:04:05.178381 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.178353    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"
Oct 30 21:04:05.178487 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.178392    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft" event={"ID":"172e9bb0-da74-45a8-9bdf-b40f49a91b2b","Type":"ContainerDied","Data":"c667dd1f6be29f56de8782707dc45fbcd89bec960732895f93c882cb20b656c2"}
Oct 30 21:04:05.186909 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.186887    6048 scope.go:122] "RemoveContainer" containerID="8dd1683fb40e6ae6193bb37ca0dc1632efb4c7370f6229442d5ff9d208ea76fe"
Oct 30 21:04:05.205996 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.205973    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"]
Oct 30 21:04:05.210144 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.210114    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-t87ft"]
Oct 30 21:04:05.223145 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.223117    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"]
Oct 30 21:04:05.234199 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.234169    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-c4b379-openshift-default-57fdd6d787-857nk"]
Oct 30 21:04:05.257686 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.257658    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" path="/var/lib/kubelet/pods/172e9bb0-da74-45a8-9bdf-b40f49a91b2b/volumes"
Oct 30 21:04:05.258102 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.258086    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c2a3a351-0d0c-44f7-9807-c4e947600c12" path="/var/lib/kubelet/pods/c2a3a351-0d0c-44f7-9807-c4e947600c12/volumes"
Oct 30 21:04:05.258493 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:05.258478    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" path="/var/lib/kubelet/pods/c77a5d82-8c9e-4204-8c32-ef6585023df6/volumes"
Oct 30 21:04:16.800351 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:04:16.800315    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:04:23.196951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.196906    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"]
Oct 30 21:04:23.197412 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197397    6048 cpu_manager.go:414] "containerMap: removing container" podUID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" containerName="istio-proxy"
Oct 30 21:04:23.197457 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197413    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" containerName="istio-proxy"
Oct 30 21:04:23.197457 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197421    6048 cpu_manager.go:414] "containerMap: removing container" podUID="c2a3a351-0d0c-44f7-9807-c4e947600c12" containerName="istio-proxy"
Oct 30 21:04:23.197457 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197426    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2a3a351-0d0c-44f7-9807-c4e947600c12" containerName="istio-proxy"
Oct 30 21:04:23.197457 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197440    6048 cpu_manager.go:414] "containerMap: removing container" podUID="979f3391-e235-43e7-9521-b40b1e831c32" containerName="revoke-keys"
Oct 30 21:04:23.197457 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197446    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="979f3391-e235-43e7-9521-b40b1e831c32" containerName="revoke-keys"
Oct 30 21:04:23.197607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197463    6048 cpu_manager.go:414] "containerMap: removing container" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main"
Oct 30 21:04:23.197607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197469    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main"
Oct 30 21:04:23.197607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197482    6048 cpu_manager.go:414] "containerMap: removing container" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy"
Oct 30 21:04:23.197607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197486    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy"
Oct 30 21:04:23.197607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197550    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="172e9bb0-da74-45a8-9bdf-b40f49a91b2b" containerName="istio-proxy"
Oct 30 21:04:23.197607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197558    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2a3a351-0d0c-44f7-9807-c4e947600c12" containerName="istio-proxy"
Oct 30 21:04:23.197607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197566    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="979f3391-e235-43e7-9521-b40b1e831c32" containerName="revoke-keys"
Oct 30 21:04:23.197607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197573    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="1117c12d-3aba-40d8-a4b0-0c7aa9a19d27" containerName="main"
Oct 30 21:04:23.197607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.197580    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="c77a5d82-8c9e-4204-8c32-ef6585023df6" containerName="istio-proxy"
Oct 30 21:04:23.201125 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.201108    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:23.208876 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.208838    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:04:23.208984 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.208876    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:04:23.208984 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.208968    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:04:23.209096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.209057    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:04:23.212281 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.212253    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"]
Oct 30 21:04:23.341177 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.341141    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6clq\" (UniqueName: \"kubernetes.io/projected/61eb35f6-528b-4937-9ef6-071622ac2800-kube-api-access-k6clq\") pod \"maas-api-revoke-sub-85237e45-vjslj\" (UID: \"61eb35f6-528b-4937-9ef6-071622ac2800\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:23.341355 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.341221    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85237e45-vjslj\" (UID: \"61eb35f6-528b-4937-9ef6-071622ac2800\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:23.341355 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.341290    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85237e45-vjslj\" (UID: \"61eb35f6-528b-4937-9ef6-071622ac2800\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:23.442286 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.442251    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6clq\" (UniqueName: \"kubernetes.io/projected/61eb35f6-528b-4937-9ef6-071622ac2800-kube-api-access-k6clq\") pod \"maas-api-revoke-sub-85237e45-vjslj\" (UID: \"61eb35f6-528b-4937-9ef6-071622ac2800\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:23.442469 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.442344    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85237e45-vjslj\" (UID: \"61eb35f6-528b-4937-9ef6-071622ac2800\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:23.442469 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.442410    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85237e45-vjslj\" (UID: \"61eb35f6-528b-4937-9ef6-071622ac2800\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:23.443128 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.443099    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85237e45-vjslj\" (UID: \"61eb35f6-528b-4937-9ef6-071622ac2800\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:23.444766 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.444749    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85237e45-vjslj\" (UID: \"61eb35f6-528b-4937-9ef6-071622ac2800\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:23.455266 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.455209    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6clq\" (UniqueName: \"kubernetes.io/projected/61eb35f6-528b-4937-9ef6-071622ac2800-kube-api-access-k6clq\") pod \"maas-api-revoke-sub-85237e45-vjslj\" (UID: \"61eb35f6-528b-4937-9ef6-071622ac2800\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:23.515336 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.515312    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:23.791874 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:23.791841    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"]
Oct 30 21:04:23.793032 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:04:23.792993    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61eb35f6_528b_4937_9ef6_071622ac2800.slice/crio-4d9143d8de3fede9a45c65cb22a15107a594d1b6a7b3d36efc04324061c9de7c WatchSource:0}: Error finding container 4d9143d8de3fede9a45c65cb22a15107a594d1b6a7b3d36efc04324061c9de7c: Status 404 returned error can't find the container with id 4d9143d8de3fede9a45c65cb22a15107a594d1b6a7b3d36efc04324061c9de7c
Oct 30 21:04:24.033943 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:24.033915    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"]
Oct 30 21:04:24.036189 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:24.036165    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-293eed40-4mrpv"]
Oct 30 21:04:24.301346 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:24.301256    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj" event={"ID":"61eb35f6-528b-4937-9ef6-071622ac2800","Type":"ContainerStarted","Data":"87fcc8cb3a15fef39042506ef4ef6dc68c752e7dcfa8ab40cc4a2870246d1eae"}
Oct 30 21:04:24.301346 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:24.301318    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj" event={"ID":"61eb35f6-528b-4937-9ef6-071622ac2800","Type":"ContainerStarted","Data":"4d9143d8de3fede9a45c65cb22a15107a594d1b6a7b3d36efc04324061c9de7c"}
Oct 30 21:04:24.322841 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:24.322790    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj" podStartSLOduration=1.3227769999999999 podStartE2EDuration="1.322777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:04:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:04:24.320657818 +0000 UTC m=+1475.179394115" watchObservedRunningTime="2026-10-30 21:04:24.322777 +0000 UTC m=+1475.181513292"
Oct 30 21:04:25.257767 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:25.257734    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="73bfa83c-ba27-4f6c-b3c8-ea3c010b2158" path="/var/lib/kubelet/pods/73bfa83c-ba27-4f6c-b3c8-ea3c010b2158/volumes"
Oct 30 21:04:25.308654 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:25.308615    6048 generic.go:356] "Generic (PLEG): container finished" podID="61eb35f6-528b-4937-9ef6-071622ac2800" containerID="87fcc8cb3a15fef39042506ef4ef6dc68c752e7dcfa8ab40cc4a2870246d1eae" exitCode=0
Oct 30 21:04:25.309084 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:25.308704    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj" event={"ID":"61eb35f6-528b-4937-9ef6-071622ac2800","Type":"ContainerDied","Data":"87fcc8cb3a15fef39042506ef4ef6dc68c752e7dcfa8ab40cc4a2870246d1eae"}
Oct 30 21:04:26.482844 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:26.482812    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:26.574842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:26.574738    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61eb35f6-528b-4937-9ef6-071622ac2800-kube-api-access-k6clq\" (UniqueName: \"kubernetes.io/projected/61eb35f6-528b-4937-9ef6-071622ac2800-kube-api-access-k6clq\") pod \"61eb35f6-528b-4937-9ef6-071622ac2800\" (UID: \"61eb35f6-528b-4937-9ef6-071622ac2800\") "
Oct 30 21:04:26.574842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:26.574804    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-xks-ca\") pod \"61eb35f6-528b-4937-9ef6-071622ac2800\" (UID: \"61eb35f6-528b-4937-9ef6-071622ac2800\") "
Oct 30 21:04:26.575428 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:26.574986    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-openshift-ca\") pod \"61eb35f6-528b-4937-9ef6-071622ac2800\" (UID: \"61eb35f6-528b-4937-9ef6-071622ac2800\") "
Oct 30 21:04:26.575515 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:26.575485    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-openshift-ca" pod "61eb35f6-528b-4937-9ef6-071622ac2800" (UID: "61eb35f6-528b-4937-9ef6-071622ac2800"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:04:26.577214 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:26.577182    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61eb35f6-528b-4937-9ef6-071622ac2800-kube-api-access-k6clq" pod "61eb35f6-528b-4937-9ef6-071622ac2800" (UID: "61eb35f6-528b-4937-9ef6-071622ac2800"). InnerVolumeSpecName "kube-api-access-k6clq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:26.577493 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:26.577467    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-xks-ca" pod "61eb35f6-528b-4937-9ef6-071622ac2800" (UID: "61eb35f6-528b-4937-9ef6-071622ac2800"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:04:26.676587 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:26.676554    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6clq\" (UniqueName: \"kubernetes.io/projected/61eb35f6-528b-4937-9ef6-071622ac2800-kube-api-access-k6clq\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:26.676587 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:26.676587    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:26.676787 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:26.676600    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/61eb35f6-528b-4937-9ef6-071622ac2800-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:04:27.322181 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:27.322147    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj" event={"ID":"61eb35f6-528b-4937-9ef6-071622ac2800","Type":"ContainerDied","Data":"4d9143d8de3fede9a45c65cb22a15107a594d1b6a7b3d36efc04324061c9de7c"}
Oct 30 21:04:27.322181 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:27.322173    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"
Oct 30 21:04:27.322414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:27.322198    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d9143d8de3fede9a45c65cb22a15107a594d1b6a7b3d36efc04324061c9de7c"
Oct 30 21:04:36.025880 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:36.025840    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"]
Oct 30 21:04:36.028553 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:36.028522    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1322acf4-q2wq9"]
Oct 30 21:04:37.257380 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:37.257336    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d8d77ef-6564-4089-9112-c53d155a3476" path="/var/lib/kubelet/pods/3d8d77ef-6564-4089-9112-c53d155a3476/volumes"
Oct 30 21:04:38.029230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:38.029188    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"]
Oct 30 21:04:38.032760 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:38.032733    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bc1326ae-b9fjd"]
Oct 30 21:04:39.266646 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:39.266612    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b728d161-5dc0-46f6-80a6-299e267d72ec" path="/var/lib/kubelet/pods/b728d161-5dc0-46f6-80a6-299e267d72ec/volumes"
Oct 30 21:04:45.025626 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:45.025582    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"]
Oct 30 21:04:45.030987 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:45.030960    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dde18254-jz4js"]
Oct 30 21:04:45.258222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:45.258193    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14fa311e-623d-4d1f-bf25-afa22a9657be" path="/var/lib/kubelet/pods/14fa311e-623d-4d1f-bf25-afa22a9657be/volumes"
Oct 30 21:04:46.803236 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:04:46.803195    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:04:49.800412 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:49.800378    6048 scope.go:122] "RemoveContainer" containerID="18323d1f8dc84cf9ae4ef9d616932003124eaa96c399b621c3a6705a60981090"
Oct 30 21:04:51.029111 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:51.029075    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"]
Oct 30 21:04:51.033178 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:51.033144    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"]
Oct 30 21:04:51.035359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:51.035336    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2a96bb3b-w5xb5"]
Oct 30 21:04:51.037124 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:51.037105    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f9ba84f8-bnnmq"]
Oct 30 21:04:51.257384 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:51.257343    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8" path="/var/lib/kubelet/pods/cb7b5bff-913d-4ae9-a9da-6e84dfe9c8e8/volumes"
Oct 30 21:04:51.257822 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:04:51.257801    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ec3aecaa-bdc2-486d-9095-dd8d7ac8c531" path="/var/lib/kubelet/pods/ec3aecaa-bdc2-486d-9095-dd8d7ac8c531/volumes"
Oct 30 21:05:02.029134 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:02.029097    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"]
Oct 30 21:05:02.032091 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:02.032069    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6a4698fe-4zrjs"]
Oct 30 21:05:03.258202 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:03.258157    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="00cad676-35e3-454e-aa9e-7d238294557c" path="/var/lib/kubelet/pods/00cad676-35e3-454e-aa9e-7d238294557c/volumes"
Oct 30 21:05:04.025510 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:04.025474    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"]
Oct 30 21:05:04.028676 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:04.028646    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79c283d6-5hr2r"]
Oct 30 21:05:05.257592 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:05.257554    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8aa1d5f8-757a-451f-bf2f-ca7af796ef5c" path="/var/lib/kubelet/pods/8aa1d5f8-757a-451f-bf2f-ca7af796ef5c/volumes"
Oct 30 21:05:14.141366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.141324    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"]
Oct 30 21:05:14.141869 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.141851    6048 cpu_manager.go:414] "containerMap: removing container" podUID="61eb35f6-528b-4937-9ef6-071622ac2800" containerName="revoke-keys"
Oct 30 21:05:14.141914 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.141871    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61eb35f6-528b-4937-9ef6-071622ac2800" containerName="revoke-keys"
Oct 30 21:05:14.141976 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.141966    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="61eb35f6-528b-4937-9ef6-071622ac2800" containerName="revoke-keys"
Oct 30 21:05:14.145307 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.145291    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:14.151174 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.151149    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:05:14.152661 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.152619    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:05:14.154979 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.154958    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"]
Oct 30 21:05:14.198671 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.198633    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:05:14.198836 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.198739    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:05:14.221410 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.221379    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-kl7fn\" (UID: \"3522396e-bf9f-4375-8805-aa416419ecb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:14.221532 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.221421    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-kl7fn\" (UID: \"3522396e-bf9f-4375-8805-aa416419ecb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:14.221532 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.221516    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz4n7\" (UniqueName: \"kubernetes.io/projected/3522396e-bf9f-4375-8805-aa416419ecb2-kube-api-access-mz4n7\") pod \"maas-api-revoke-sub-c1e271a9-kl7fn\" (UID: \"3522396e-bf9f-4375-8805-aa416419ecb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:14.322070 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.322037    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-kl7fn\" (UID: \"3522396e-bf9f-4375-8805-aa416419ecb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:14.322224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.322098    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz4n7\" (UniqueName: \"kubernetes.io/projected/3522396e-bf9f-4375-8805-aa416419ecb2-kube-api-access-mz4n7\") pod \"maas-api-revoke-sub-c1e271a9-kl7fn\" (UID: \"3522396e-bf9f-4375-8805-aa416419ecb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:14.322620 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.322358    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-kl7fn\" (UID: \"3522396e-bf9f-4375-8805-aa416419ecb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:14.323007 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.322981    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-kl7fn\" (UID: \"3522396e-bf9f-4375-8805-aa416419ecb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:14.324539 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.324518    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-kl7fn\" (UID: \"3522396e-bf9f-4375-8805-aa416419ecb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:14.334226 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.334206    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz4n7\" (UniqueName: \"kubernetes.io/projected/3522396e-bf9f-4375-8805-aa416419ecb2-kube-api-access-mz4n7\") pod \"maas-api-revoke-sub-c1e271a9-kl7fn\" (UID: \"3522396e-bf9f-4375-8805-aa416419ecb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:14.461204 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.461129    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:14.737230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:14.737201    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"]
Oct 30 21:05:14.739224 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:05:14.739198    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3522396e_bf9f_4375_8805_aa416419ecb2.slice/crio-10e8f1a308ec0a10026ee9ad6debe6697ed74d186cefb2122053e23b2ac0b137 WatchSource:0}: Error finding container 10e8f1a308ec0a10026ee9ad6debe6697ed74d186cefb2122053e23b2ac0b137: Status 404 returned error can't find the container with id 10e8f1a308ec0a10026ee9ad6debe6697ed74d186cefb2122053e23b2ac0b137
Oct 30 21:05:15.024410 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:15.024330    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"]
Oct 30 21:05:15.027288 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:15.027260    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6dbaa05f-w8w98"]
Oct 30 21:05:15.257378 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:15.257341    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="476fc1eb-7bc7-4cde-9e2d-28e71cbb681c" path="/var/lib/kubelet/pods/476fc1eb-7bc7-4cde-9e2d-28e71cbb681c/volumes"
Oct 30 21:05:15.644797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:15.644764    6048 generic.go:356] "Generic (PLEG): container finished" podID="3522396e-bf9f-4375-8805-aa416419ecb2" containerID="0757c49b94223f39a78b6ddd662061fe600418b34e520c02c4ccc635ecdf12b3" exitCode=0
Oct 30 21:05:15.644961 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:15.644844    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn" event={"ID":"3522396e-bf9f-4375-8805-aa416419ecb2","Type":"ContainerDied","Data":"0757c49b94223f39a78b6ddd662061fe600418b34e520c02c4ccc635ecdf12b3"}
Oct 30 21:05:15.644961 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:15.644899    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn" event={"ID":"3522396e-bf9f-4375-8805-aa416419ecb2","Type":"ContainerStarted","Data":"10e8f1a308ec0a10026ee9ad6debe6697ed74d186cefb2122053e23b2ac0b137"}
Oct 30 21:05:16.800931 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:16.800897    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:16.803553 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:05:16.803526    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:05:16.949755 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:16.949664    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-openshift-ca\") pod \"3522396e-bf9f-4375-8805-aa416419ecb2\" (UID: \"3522396e-bf9f-4375-8805-aa416419ecb2\") "
Oct 30 21:05:16.949755 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:16.949739    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-xks-ca\") pod \"3522396e-bf9f-4375-8805-aa416419ecb2\" (UID: \"3522396e-bf9f-4375-8805-aa416419ecb2\") "
Oct 30 21:05:16.949968 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:16.949859    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3522396e-bf9f-4375-8805-aa416419ecb2-kube-api-access-mz4n7\" (UniqueName: \"kubernetes.io/projected/3522396e-bf9f-4375-8805-aa416419ecb2-kube-api-access-mz4n7\") pod \"3522396e-bf9f-4375-8805-aa416419ecb2\" (UID: \"3522396e-bf9f-4375-8805-aa416419ecb2\") "
Oct 30 21:05:16.950072 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:16.950050    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-openshift-ca" pod "3522396e-bf9f-4375-8805-aa416419ecb2" (UID: "3522396e-bf9f-4375-8805-aa416419ecb2"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:05:16.950235 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:16.950219    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:05:16.951899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:16.951875    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-xks-ca" pod "3522396e-bf9f-4375-8805-aa416419ecb2" (UID: "3522396e-bf9f-4375-8805-aa416419ecb2"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:05:16.951899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:16.951885    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3522396e-bf9f-4375-8805-aa416419ecb2-kube-api-access-mz4n7" pod "3522396e-bf9f-4375-8805-aa416419ecb2" (UID: "3522396e-bf9f-4375-8805-aa416419ecb2"). InnerVolumeSpecName "kube-api-access-mz4n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:05:17.051784 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:17.051741    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3522396e-bf9f-4375-8805-aa416419ecb2-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:05:17.051784 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:17.051778    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz4n7\" (UniqueName: \"kubernetes.io/projected/3522396e-bf9f-4375-8805-aa416419ecb2-kube-api-access-mz4n7\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:05:17.659402 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:17.659362    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn" event={"ID":"3522396e-bf9f-4375-8805-aa416419ecb2","Type":"ContainerDied","Data":"10e8f1a308ec0a10026ee9ad6debe6697ed74d186cefb2122053e23b2ac0b137"}
Oct 30 21:05:17.659595 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:17.659405    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"
Oct 30 21:05:17.659595 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:17.659426    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10e8f1a308ec0a10026ee9ad6debe6697ed74d186cefb2122053e23b2ac0b137"
Oct 30 21:05:19.023802 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:19.023762    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"]
Oct 30 21:05:19.027103 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:19.027075    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dc58cd6d-bclk9"]
Oct 30 21:05:19.258567 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:19.258529    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="272bbc3d-59d4-41ac-b7c4-0bb71f2e7327" path="/var/lib/kubelet/pods/272bbc3d-59d4-41ac-b7c4-0bb71f2e7327/volumes"
Oct 30 21:05:25.029114 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:25.029074    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"]
Oct 30 21:05:25.032056 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:25.032006    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-86184318-g2jhb"]
Oct 30 21:05:25.258867 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:25.258830    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2599170e-31fb-4be9-ad82-2d6b5ec96d5e" path="/var/lib/kubelet/pods/2599170e-31fb-4be9-ad82-2d6b5ec96d5e/volumes"
Oct 30 21:05:35.038773 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.038673    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"]
Oct 30 21:05:35.039231 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.039197    6048 cpu_manager.go:414] "containerMap: removing container" podUID="3522396e-bf9f-4375-8805-aa416419ecb2" containerName="revoke-keys"
Oct 30 21:05:35.039231 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.039212    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3522396e-bf9f-4375-8805-aa416419ecb2" containerName="revoke-keys"
Oct 30 21:05:35.039310 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.039289    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="3522396e-bf9f-4375-8805-aa416419ecb2" containerName="revoke-keys"
Oct 30 21:05:35.043679 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.043663    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:35.049907 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.049869    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:05:35.050118 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.050098    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:05:35.050309 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.050287    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:05:35.050439 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.050347    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:05:35.053698 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.053673    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"]
Oct 30 21:05:35.195208 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.195173    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/09257d87-0535-4506-be26-acbfa116800c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-rspxg\" (UID: \"09257d87-0535-4506-be26-acbfa116800c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:35.195414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.195231    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/09257d87-0535-4506-be26-acbfa116800c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-rspxg\" (UID: \"09257d87-0535-4506-be26-acbfa116800c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:35.195488 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.195468    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc2mg\" (UniqueName: \"kubernetes.io/projected/09257d87-0535-4506-be26-acbfa116800c-kube-api-access-fc2mg\") pod \"maas-api-revoke-sub-2e1f5b5f-rspxg\" (UID: \"09257d87-0535-4506-be26-acbfa116800c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:35.296744 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.296665    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/09257d87-0535-4506-be26-acbfa116800c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-rspxg\" (UID: \"09257d87-0535-4506-be26-acbfa116800c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:35.296890 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.296770    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc2mg\" (UniqueName: \"kubernetes.io/projected/09257d87-0535-4506-be26-acbfa116800c-kube-api-access-fc2mg\") pod \"maas-api-revoke-sub-2e1f5b5f-rspxg\" (UID: \"09257d87-0535-4506-be26-acbfa116800c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:35.296890 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.296802    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/09257d87-0535-4506-be26-acbfa116800c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-rspxg\" (UID: \"09257d87-0535-4506-be26-acbfa116800c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:35.297473 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.297453    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/09257d87-0535-4506-be26-acbfa116800c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-rspxg\" (UID: \"09257d87-0535-4506-be26-acbfa116800c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:35.298996 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.298976    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/09257d87-0535-4506-be26-acbfa116800c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-rspxg\" (UID: \"09257d87-0535-4506-be26-acbfa116800c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:35.309270 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.309244    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc2mg\" (UniqueName: \"kubernetes.io/projected/09257d87-0535-4506-be26-acbfa116800c-kube-api-access-fc2mg\") pod \"maas-api-revoke-sub-2e1f5b5f-rspxg\" (UID: \"09257d87-0535-4506-be26-acbfa116800c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:35.359580 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.359556    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:35.638307 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.638276    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"]
Oct 30 21:05:35.640811 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:05:35.640783    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09257d87_0535_4506_be26_acbfa116800c.slice/crio-9ffc169b8cb95800f6e59bb69877e2a1749fd10b9c9c153b87b562812c2c1fa3 WatchSource:0}: Error finding container 9ffc169b8cb95800f6e59bb69877e2a1749fd10b9c9c153b87b562812c2c1fa3: Status 404 returned error can't find the container with id 9ffc169b8cb95800f6e59bb69877e2a1749fd10b9c9c153b87b562812c2c1fa3
Oct 30 21:05:35.785817 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:35.785785    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg" event={"ID":"09257d87-0535-4506-be26-acbfa116800c","Type":"ContainerStarted","Data":"9ffc169b8cb95800f6e59bb69877e2a1749fd10b9c9c153b87b562812c2c1fa3"}
Oct 30 21:05:36.793437 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:36.793343    6048 generic.go:356] "Generic (PLEG): container finished" podID="09257d87-0535-4506-be26-acbfa116800c" containerID="da05c64b94102f2a2a1f99acabfefed68b11b2c5ee2cecdce475ff84b12eaab1" exitCode=0
Oct 30 21:05:36.793870 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:36.793428    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg" event={"ID":"09257d87-0535-4506-be26-acbfa116800c","Type":"ContainerDied","Data":"da05c64b94102f2a2a1f99acabfefed68b11b2c5ee2cecdce475ff84b12eaab1"}
Oct 30 21:05:37.938711 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:37.938686    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:38.028406 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:38.028371    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09257d87-0535-4506-be26-acbfa116800c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/09257d87-0535-4506-be26-acbfa116800c-maas-api-xks-ca\") pod \"09257d87-0535-4506-be26-acbfa116800c\" (UID: \"09257d87-0535-4506-be26-acbfa116800c\") "
Oct 30 21:05:38.028575 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:38.028447    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09257d87-0535-4506-be26-acbfa116800c-kube-api-access-fc2mg\" (UniqueName: \"kubernetes.io/projected/09257d87-0535-4506-be26-acbfa116800c-kube-api-access-fc2mg\") pod \"09257d87-0535-4506-be26-acbfa116800c\" (UID: \"09257d87-0535-4506-be26-acbfa116800c\") "
Oct 30 21:05:38.028575 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:38.028509    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09257d87-0535-4506-be26-acbfa116800c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/09257d87-0535-4506-be26-acbfa116800c-maas-api-openshift-ca\") pod \"09257d87-0535-4506-be26-acbfa116800c\" (UID: \"09257d87-0535-4506-be26-acbfa116800c\") "
Oct 30 21:05:38.028891 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:38.028868    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09257d87-0535-4506-be26-acbfa116800c-maas-api-openshift-ca" pod "09257d87-0535-4506-be26-acbfa116800c" (UID: "09257d87-0535-4506-be26-acbfa116800c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:05:38.030538 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:38.030514    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09257d87-0535-4506-be26-acbfa116800c-maas-api-xks-ca" pod "09257d87-0535-4506-be26-acbfa116800c" (UID: "09257d87-0535-4506-be26-acbfa116800c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:05:38.030538 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:38.030529    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09257d87-0535-4506-be26-acbfa116800c-kube-api-access-fc2mg" pod "09257d87-0535-4506-be26-acbfa116800c" (UID: "09257d87-0535-4506-be26-acbfa116800c"). InnerVolumeSpecName "kube-api-access-fc2mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:05:38.130145 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:38.130119    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/09257d87-0535-4506-be26-acbfa116800c-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:05:38.130145 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:38.130144    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc2mg\" (UniqueName: \"kubernetes.io/projected/09257d87-0535-4506-be26-acbfa116800c-kube-api-access-fc2mg\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:05:38.130308 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:38.130154    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/09257d87-0535-4506-be26-acbfa116800c-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:05:38.807132 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:38.807099    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"
Oct 30 21:05:38.807310 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:38.807138    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg" event={"ID":"09257d87-0535-4506-be26-acbfa116800c","Type":"ContainerDied","Data":"9ffc169b8cb95800f6e59bb69877e2a1749fd10b9c9c153b87b562812c2c1fa3"}
Oct 30 21:05:38.807310 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:38.807188    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ffc169b8cb95800f6e59bb69877e2a1749fd10b9c9c153b87b562812c2c1fa3"
Oct 30 21:05:46.029078 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.029043    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"]
Oct 30 21:05:46.029522 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.029509    6048 cpu_manager.go:414] "containerMap: removing container" podUID="09257d87-0535-4506-be26-acbfa116800c" containerName="revoke-keys"
Oct 30 21:05:46.029563 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.029523    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09257d87-0535-4506-be26-acbfa116800c" containerName="revoke-keys"
Oct 30 21:05:46.029625 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.029616    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="09257d87-0535-4506-be26-acbfa116800c" containerName="revoke-keys"
Oct 30 21:05:46.032829 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.032810    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:46.040172 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.040149    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:05:46.040304 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.040178    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:05:46.040304 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.040248    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:05:46.040708 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.040675    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:05:46.043005 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.042978    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"]
Oct 30 21:05:46.114542 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.114509    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ec843018-hfw8z\" (UID: \"5cbb909a-45ba-444b-89b9-937aae78e0f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:46.114708 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.114625    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ec843018-hfw8z\" (UID: \"5cbb909a-45ba-444b-89b9-937aae78e0f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:46.114708 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.114691    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj7wj\" (UniqueName: \"kubernetes.io/projected/5cbb909a-45ba-444b-89b9-937aae78e0f9-kube-api-access-gj7wj\") pod \"maas-api-revoke-sub-ec843018-hfw8z\" (UID: \"5cbb909a-45ba-444b-89b9-937aae78e0f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:46.215361 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.215325    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ec843018-hfw8z\" (UID: \"5cbb909a-45ba-444b-89b9-937aae78e0f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:46.215549 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.215383    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ec843018-hfw8z\" (UID: \"5cbb909a-45ba-444b-89b9-937aae78e0f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:46.215549 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.215424    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj7wj\" (UniqueName: \"kubernetes.io/projected/5cbb909a-45ba-444b-89b9-937aae78e0f9-kube-api-access-gj7wj\") pod \"maas-api-revoke-sub-ec843018-hfw8z\" (UID: \"5cbb909a-45ba-444b-89b9-937aae78e0f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:46.216171 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.216143    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ec843018-hfw8z\" (UID: \"5cbb909a-45ba-444b-89b9-937aae78e0f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:46.217834 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.217803    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ec843018-hfw8z\" (UID: \"5cbb909a-45ba-444b-89b9-937aae78e0f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:46.228139 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.228112    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj7wj\" (UniqueName: \"kubernetes.io/projected/5cbb909a-45ba-444b-89b9-937aae78e0f9-kube-api-access-gj7wj\") pod \"maas-api-revoke-sub-ec843018-hfw8z\" (UID: \"5cbb909a-45ba-444b-89b9-937aae78e0f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:46.346590 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.346554    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:46.641376 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.641347    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"]
Oct 30 21:05:46.643387 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:05:46.643359    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cbb909a_45ba_444b_89b9_937aae78e0f9.slice/crio-5dd71324fd873e1e214ed3b9c8704891165d5861cae3abe00da9f90156f4e7f2 WatchSource:0}: Error finding container 5dd71324fd873e1e214ed3b9c8704891165d5861cae3abe00da9f90156f4e7f2: Status 404 returned error can't find the container with id 5dd71324fd873e1e214ed3b9c8704891165d5861cae3abe00da9f90156f4e7f2
Oct 30 21:05:46.801616 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:05:46.801572    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:05:46.855662 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:46.855630    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z" event={"ID":"5cbb909a-45ba-444b-89b9-937aae78e0f9","Type":"ContainerStarted","Data":"5dd71324fd873e1e214ed3b9c8704891165d5861cae3abe00da9f90156f4e7f2"}
Oct 30 21:05:47.863400 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:47.863363    6048 generic.go:356] "Generic (PLEG): container finished" podID="5cbb909a-45ba-444b-89b9-937aae78e0f9" containerID="9c3806da2120d458f7d338dce869f23beeb8a524c3b8253e74ad8ec987280f24" exitCode=0
Oct 30 21:05:47.863808 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:47.863444    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z" event={"ID":"5cbb909a-45ba-444b-89b9-937aae78e0f9","Type":"ContainerDied","Data":"9c3806da2120d458f7d338dce869f23beeb8a524c3b8253e74ad8ec987280f24"}
Oct 30 21:05:49.454269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.454238    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:49.636168 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.631622    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-xks-ca\") pod \"5cbb909a-45ba-444b-89b9-937aae78e0f9\" (UID: \"5cbb909a-45ba-444b-89b9-937aae78e0f9\") "
Oct 30 21:05:49.636168 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.631716    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-openshift-ca\") pod \"5cbb909a-45ba-444b-89b9-937aae78e0f9\" (UID: \"5cbb909a-45ba-444b-89b9-937aae78e0f9\") "
Oct 30 21:05:49.636168 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.631793    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5cbb909a-45ba-444b-89b9-937aae78e0f9-kube-api-access-gj7wj\" (UniqueName: \"kubernetes.io/projected/5cbb909a-45ba-444b-89b9-937aae78e0f9-kube-api-access-gj7wj\") pod \"5cbb909a-45ba-444b-89b9-937aae78e0f9\" (UID: \"5cbb909a-45ba-444b-89b9-937aae78e0f9\") "
Oct 30 21:05:49.638421 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.637540    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-openshift-ca" pod "5cbb909a-45ba-444b-89b9-937aae78e0f9" (UID: "5cbb909a-45ba-444b-89b9-937aae78e0f9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:05:49.804075 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.746164    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:05:49.885046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.872998    6048 scope.go:122] "RemoveContainer" containerID="7c2e8737ab8d641f3b185d86328f8e5ef3e0f614b94631e3beb07535ac693279"
Oct 30 21:05:49.889495 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.889122    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-xks-ca" pod "5cbb909a-45ba-444b-89b9-937aae78e0f9" (UID: "5cbb909a-45ba-444b-89b9-937aae78e0f9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:05:49.889495 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.889407    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cbb909a-45ba-444b-89b9-937aae78e0f9-kube-api-access-gj7wj" pod "5cbb909a-45ba-444b-89b9-937aae78e0f9" (UID: "5cbb909a-45ba-444b-89b9-937aae78e0f9"). InnerVolumeSpecName "kube-api-access-gj7wj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:05:49.932067 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.923821    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z" event={"ID":"5cbb909a-45ba-444b-89b9-937aae78e0f9","Type":"ContainerDied","Data":"5dd71324fd873e1e214ed3b9c8704891165d5861cae3abe00da9f90156f4e7f2"}
Oct 30 21:05:49.932067 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.923887    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5dd71324fd873e1e214ed3b9c8704891165d5861cae3abe00da9f90156f4e7f2"
Oct 30 21:05:49.932067 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.923972    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"
Oct 30 21:05:49.962152 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.958918    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5cbb909a-45ba-444b-89b9-937aae78e0f9-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:05:49.962152 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:49.958951    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj7wj\" (UniqueName: \"kubernetes.io/projected/5cbb909a-45ba-444b-89b9-937aae78e0f9-kube-api-access-gj7wj\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:05:50.037496 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:50.037373    6048 scope.go:122] "RemoveContainer" containerID="34605b671f9147345dc2ca0caaa3af422adf5014c5d5568d252113c96f8701f7"
Oct 30 21:05:50.149089 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:50.147304    6048 scope.go:122] "RemoveContainer" containerID="20fb2cd87d6bc4db1a9f19fe510d51a394bfff8cf77e72a9293c3d378e08aff9"
Oct 30 21:05:50.224046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:50.222176    6048 scope.go:122] "RemoveContainer" containerID="c38ec13b3e5b1489ff30f5f5cd05e3be804481a6fa2be00d8c39979281873366"
Oct 30 21:05:50.322054 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:50.308220    6048 scope.go:122] "RemoveContainer" containerID="715fca57c25d474b37b3e8961dc5b2b06e40f6530a00eeed561c5fc7af58e02b"
Oct 30 21:05:50.342228 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:50.341604    6048 scope.go:122] "RemoveContainer" containerID="e1a3a008c1ccfe46327cc6ed30643bed3665e65e4f2e53d78dfe0e1972692af1"
Oct 30 21:05:51.153046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:51.152175    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q8xpm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:05:51.153046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:05:51.152243    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:06:04.152954 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:04.152194    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-t97cq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:06:04.152954 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:04.152286    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:06:14.425247 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.425212    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"]
Oct 30 21:06:14.425718 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.425667    6048 cpu_manager.go:414] "containerMap: removing container" podUID="5cbb909a-45ba-444b-89b9-937aae78e0f9" containerName="revoke-keys"
Oct 30 21:06:14.425718 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.425680    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5cbb909a-45ba-444b-89b9-937aae78e0f9" containerName="revoke-keys"
Oct 30 21:06:14.425791 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.425757    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="5cbb909a-45ba-444b-89b9-937aae78e0f9" containerName="revoke-keys"
Oct 30 21:06:14.429074 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.429016    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:14.434540 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.434517    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:06:14.436186 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.436040    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:06:14.436186 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.436054    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:06:14.436186 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.436158    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:06:14.440523 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.440498    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"]
Oct 30 21:06:14.492688 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.492657    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-046e1343-jtrsq\" (UID: \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:14.492879 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.492699    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-xks-ca\") pod \"maas-api-revoke-sub-046e1343-jtrsq\" (UID: \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:14.492956 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.492888    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccb4h\" (UniqueName: \"kubernetes.io/projected/0febaa0a-61d9-41d5-85e9-b2a581aeca58-kube-api-access-ccb4h\") pod \"maas-api-revoke-sub-046e1343-jtrsq\" (UID: \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:14.594245 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.594207    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccb4h\" (UniqueName: \"kubernetes.io/projected/0febaa0a-61d9-41d5-85e9-b2a581aeca58-kube-api-access-ccb4h\") pod \"maas-api-revoke-sub-046e1343-jtrsq\" (UID: \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:14.594414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.594272    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-046e1343-jtrsq\" (UID: \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:14.594414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.594295    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-xks-ca\") pod \"maas-api-revoke-sub-046e1343-jtrsq\" (UID: \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:14.594956 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.594930    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-046e1343-jtrsq\" (UID: \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:14.596682 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.596657    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-xks-ca\") pod \"maas-api-revoke-sub-046e1343-jtrsq\" (UID: \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:14.607302 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.607282    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccb4h\" (UniqueName: \"kubernetes.io/projected/0febaa0a-61d9-41d5-85e9-b2a581aeca58-kube-api-access-ccb4h\") pod \"maas-api-revoke-sub-046e1343-jtrsq\" (UID: \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:14.744117 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:14.744014    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:15.020277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:15.020252    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"]
Oct 30 21:06:15.021596 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:06:15.021569    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0febaa0a_61d9_41d5_85e9_b2a581aeca58.slice/crio-b6469197d7d6025f62ea74de4159318695a553476589bc5ba59677e01de5f97c WatchSource:0}: Error finding container b6469197d7d6025f62ea74de4159318695a553476589bc5ba59677e01de5f97c: Status 404 returned error can't find the container with id b6469197d7d6025f62ea74de4159318695a553476589bc5ba59677e01de5f97c
Oct 30 21:06:15.145985 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:15.145950    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq" event={"ID":"0febaa0a-61d9-41d5-85e9-b2a581aeca58","Type":"ContainerStarted","Data":"b6469197d7d6025f62ea74de4159318695a553476589bc5ba59677e01de5f97c"}
Oct 30 21:06:16.153608 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:16.153575    6048 generic.go:356] "Generic (PLEG): container finished" podID="0febaa0a-61d9-41d5-85e9-b2a581aeca58" containerID="451e171fbeddd2434528330590c5417150a06bda944ef69cc6f0bc503cfa8634" exitCode=0
Oct 30 21:06:16.154087 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:16.153656    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq" event={"ID":"0febaa0a-61d9-41d5-85e9-b2a581aeca58","Type":"ContainerDied","Data":"451e171fbeddd2434528330590c5417150a06bda944ef69cc6f0bc503cfa8634"}
Oct 30 21:06:16.800062 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:06:16.800008    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:06:17.298316 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:17.298290    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:17.423337 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:17.423257    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-openshift-ca\") pod \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\" (UID: \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\") "
Oct 30 21:06:17.423337 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:17.423324    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-xks-ca\") pod \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\" (UID: \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\") "
Oct 30 21:06:17.423553 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:17.423381    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0febaa0a-61d9-41d5-85e9-b2a581aeca58-kube-api-access-ccb4h\" (UniqueName: \"kubernetes.io/projected/0febaa0a-61d9-41d5-85e9-b2a581aeca58-kube-api-access-ccb4h\") pod \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\" (UID: \"0febaa0a-61d9-41d5-85e9-b2a581aeca58\") "
Oct 30 21:06:17.423693 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:17.423670    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-openshift-ca" pod "0febaa0a-61d9-41d5-85e9-b2a581aeca58" (UID: "0febaa0a-61d9-41d5-85e9-b2a581aeca58"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:06:17.423770 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:17.423742    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:17.425434 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:17.425409    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-xks-ca" pod "0febaa0a-61d9-41d5-85e9-b2a581aeca58" (UID: "0febaa0a-61d9-41d5-85e9-b2a581aeca58"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:06:17.425567 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:17.425545    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0febaa0a-61d9-41d5-85e9-b2a581aeca58-kube-api-access-ccb4h" pod "0febaa0a-61d9-41d5-85e9-b2a581aeca58" (UID: "0febaa0a-61d9-41d5-85e9-b2a581aeca58"). InnerVolumeSpecName "kube-api-access-ccb4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:06:17.524764 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:17.524726    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0febaa0a-61d9-41d5-85e9-b2a581aeca58-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:17.524764 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:17.524759    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccb4h\" (UniqueName: \"kubernetes.io/projected/0febaa0a-61d9-41d5-85e9-b2a581aeca58-kube-api-access-ccb4h\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:18.166258 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:18.166230    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"
Oct 30 21:06:18.166421 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:18.166266    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq" event={"ID":"0febaa0a-61d9-41d5-85e9-b2a581aeca58","Type":"ContainerDied","Data":"b6469197d7d6025f62ea74de4159318695a553476589bc5ba59677e01de5f97c"}
Oct 30 21:06:18.166421 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:18.166314    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6469197d7d6025f62ea74de4159318695a553476589bc5ba59677e01de5f97c"
Oct 30 21:06:24.684139 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.684104    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"]
Oct 30 21:06:24.684766 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.684614    6048 cpu_manager.go:414] "containerMap: removing container" podUID="0febaa0a-61d9-41d5-85e9-b2a581aeca58" containerName="revoke-keys"
Oct 30 21:06:24.684766 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.684631    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0febaa0a-61d9-41d5-85e9-b2a581aeca58" containerName="revoke-keys"
Oct 30 21:06:24.684766 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.684749    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="0febaa0a-61d9-41d5-85e9-b2a581aeca58" containerName="revoke-keys"
Oct 30 21:06:24.688246 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.688225    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:24.696946 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.696920    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:06:24.697110 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.696992    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:06:24.697177 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.697157    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:06:24.697236 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.697225    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:06:24.699248 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.699226    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"]
Oct 30 21:06:24.795572 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.795527    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsbhx\" (UniqueName: \"kubernetes.io/projected/4820e184-4306-457d-93ac-0c94a6a1b997-kube-api-access-zsbhx\") pod \"maas-api-revoke-sub-d3fba056-d74bt\" (UID: \"4820e184-4306-457d-93ac-0c94a6a1b997\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:24.795754 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.795639    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d3fba056-d74bt\" (UID: \"4820e184-4306-457d-93ac-0c94a6a1b997\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:24.795754 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.795727    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d3fba056-d74bt\" (UID: \"4820e184-4306-457d-93ac-0c94a6a1b997\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:24.897202 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.897166    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d3fba056-d74bt\" (UID: \"4820e184-4306-457d-93ac-0c94a6a1b997\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:24.897395 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.897324    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsbhx\" (UniqueName: \"kubernetes.io/projected/4820e184-4306-457d-93ac-0c94a6a1b997-kube-api-access-zsbhx\") pod \"maas-api-revoke-sub-d3fba056-d74bt\" (UID: \"4820e184-4306-457d-93ac-0c94a6a1b997\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:24.897395 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.897374    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d3fba056-d74bt\" (UID: \"4820e184-4306-457d-93ac-0c94a6a1b997\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:24.897967 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.897943    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d3fba056-d74bt\" (UID: \"4820e184-4306-457d-93ac-0c94a6a1b997\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:24.899407 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.899385    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d3fba056-d74bt\" (UID: \"4820e184-4306-457d-93ac-0c94a6a1b997\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:24.909625 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:24.909605    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsbhx\" (UniqueName: \"kubernetes.io/projected/4820e184-4306-457d-93ac-0c94a6a1b997-kube-api-access-zsbhx\") pod \"maas-api-revoke-sub-d3fba056-d74bt\" (UID: \"4820e184-4306-457d-93ac-0c94a6a1b997\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:25.003851 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:25.003772    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:25.280533 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:25.280507    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"]
Oct 30 21:06:25.282721 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:06:25.282693    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4820e184_4306_457d_93ac_0c94a6a1b997.slice/crio-ce39d5032810876a865acb93f2cc7de4fcb8678b41b101cd193a7a8722040681 WatchSource:0}: Error finding container ce39d5032810876a865acb93f2cc7de4fcb8678b41b101cd193a7a8722040681: Status 404 returned error can't find the container with id ce39d5032810876a865acb93f2cc7de4fcb8678b41b101cd193a7a8722040681
Oct 30 21:06:26.220171 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:26.220128    6048 generic.go:356] "Generic (PLEG): container finished" podID="4820e184-4306-457d-93ac-0c94a6a1b997" containerID="12eeec63abf4ca5884c8c947e6f2a242744de511560f31abf2bb4d39d50dbec7" exitCode=0
Oct 30 21:06:26.220730 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:26.220297    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt" event={"ID":"4820e184-4306-457d-93ac-0c94a6a1b997","Type":"ContainerDied","Data":"12eeec63abf4ca5884c8c947e6f2a242744de511560f31abf2bb4d39d50dbec7"}
Oct 30 21:06:26.220730 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:26.220349    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt" event={"ID":"4820e184-4306-457d-93ac-0c94a6a1b997","Type":"ContainerStarted","Data":"ce39d5032810876a865acb93f2cc7de4fcb8678b41b101cd193a7a8722040681"}
Oct 30 21:06:27.900046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:27.896372    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:28.085106 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:28.084420    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-openshift-ca\") pod \"4820e184-4306-457d-93ac-0c94a6a1b997\" (UID: \"4820e184-4306-457d-93ac-0c94a6a1b997\") "
Oct 30 21:06:28.085106 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:28.084615    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-xks-ca\") pod \"4820e184-4306-457d-93ac-0c94a6a1b997\" (UID: \"4820e184-4306-457d-93ac-0c94a6a1b997\") "
Oct 30 21:06:28.085106 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:28.084658    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4820e184-4306-457d-93ac-0c94a6a1b997-kube-api-access-zsbhx\" (UniqueName: \"kubernetes.io/projected/4820e184-4306-457d-93ac-0c94a6a1b997-kube-api-access-zsbhx\") pod \"4820e184-4306-457d-93ac-0c94a6a1b997\" (UID: \"4820e184-4306-457d-93ac-0c94a6a1b997\") "
Oct 30 21:06:28.111046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:28.110440    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-openshift-ca" pod "4820e184-4306-457d-93ac-0c94a6a1b997" (UID: "4820e184-4306-457d-93ac-0c94a6a1b997"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:06:28.148044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:28.147212    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4820e184-4306-457d-93ac-0c94a6a1b997-kube-api-access-zsbhx" pod "4820e184-4306-457d-93ac-0c94a6a1b997" (UID: "4820e184-4306-457d-93ac-0c94a6a1b997"). InnerVolumeSpecName "kube-api-access-zsbhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:06:28.196046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:28.185669    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:28.196046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:28.185705    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsbhx\" (UniqueName: \"kubernetes.io/projected/4820e184-4306-457d-93ac-0c94a6a1b997-kube-api-access-zsbhx\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:28.209217 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:28.209146    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-xks-ca" pod "4820e184-4306-457d-93ac-0c94a6a1b997" (UID: "4820e184-4306-457d-93ac-0c94a6a1b997"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:06:28.288055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:28.284949    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt" event={"ID":"4820e184-4306-457d-93ac-0c94a6a1b997","Type":"ContainerDied","Data":"ce39d5032810876a865acb93f2cc7de4fcb8678b41b101cd193a7a8722040681"}
Oct 30 21:06:28.288055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:28.285013    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce39d5032810876a865acb93f2cc7de4fcb8678b41b101cd193a7a8722040681"
Oct 30 21:06:28.288055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:28.285106    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"
Oct 30 21:06:28.300128 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:28.296931    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4820e184-4306-457d-93ac-0c94a6a1b997-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:29.024750 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:29.024709    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"]
Oct 30 21:06:29.027459 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:29.027430    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-597267e1-7k5nx"]
Oct 30 21:06:29.265251 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:29.265214    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9c22af4d-e9fa-4c42-afa9-691b151e46e2" path="/var/lib/kubelet/pods/9c22af4d-e9fa-4c42-afa9-691b151e46e2/volumes"
Oct 30 21:06:43.025156 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:43.025118    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"]
Oct 30 21:06:43.025625 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:43.025605    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9bd739b5-wr988"]
Oct 30 21:06:43.258447 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:43.258414    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4dc39679-a506-44f3-a5d3-36630be0d753" path="/var/lib/kubelet/pods/4dc39679-a506-44f3-a5d3-36630be0d753/volumes"
Oct 30 21:06:45.379144 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.379113    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"]
Oct 30 21:06:45.379578 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.379558    6048 cpu_manager.go:414] "containerMap: removing container" podUID="4820e184-4306-457d-93ac-0c94a6a1b997" containerName="revoke-keys"
Oct 30 21:06:45.379578 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.379573    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4820e184-4306-457d-93ac-0c94a6a1b997" containerName="revoke-keys"
Oct 30 21:06:45.379756 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.379640    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="4820e184-4306-457d-93ac-0c94a6a1b997" containerName="revoke-keys"
Oct 30 21:06:45.382818 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.382803    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:45.390553 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.390529    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:06:45.390812 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.390789    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:06:45.390931 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.390883    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:06:45.390931 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.390901    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:06:45.392669 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.392650    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"]
Oct 30 21:06:45.520080 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.520006    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ae594979-d49pq\" (UID: \"7a37a736-61e4-43ba-b211-cca91fb27a37\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:45.520290 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.520200    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xthsh\" (UniqueName: \"kubernetes.io/projected/7a37a736-61e4-43ba-b211-cca91fb27a37-kube-api-access-xthsh\") pod \"maas-api-revoke-sub-ae594979-d49pq\" (UID: \"7a37a736-61e4-43ba-b211-cca91fb27a37\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:45.520363 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.520322    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ae594979-d49pq\" (UID: \"7a37a736-61e4-43ba-b211-cca91fb27a37\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:45.621081 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.621045    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ae594979-d49pq\" (UID: \"7a37a736-61e4-43ba-b211-cca91fb27a37\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:45.621291 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.621135    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xthsh\" (UniqueName: \"kubernetes.io/projected/7a37a736-61e4-43ba-b211-cca91fb27a37-kube-api-access-xthsh\") pod \"maas-api-revoke-sub-ae594979-d49pq\" (UID: \"7a37a736-61e4-43ba-b211-cca91fb27a37\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:45.621291 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.621199    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ae594979-d49pq\" (UID: \"7a37a736-61e4-43ba-b211-cca91fb27a37\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:45.621734 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.621709    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ae594979-d49pq\" (UID: \"7a37a736-61e4-43ba-b211-cca91fb27a37\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:45.623503 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.623479    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ae594979-d49pq\" (UID: \"7a37a736-61e4-43ba-b211-cca91fb27a37\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:45.633630 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.633576    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xthsh\" (UniqueName: \"kubernetes.io/projected/7a37a736-61e4-43ba-b211-cca91fb27a37-kube-api-access-xthsh\") pod \"maas-api-revoke-sub-ae594979-d49pq\" (UID: \"7a37a736-61e4-43ba-b211-cca91fb27a37\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:45.699472 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.699437    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:45.975894 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:45.975869    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"]
Oct 30 21:06:45.977922 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:06:45.977895    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a37a736_61e4_43ba_b211_cca91fb27a37.slice/crio-eec3b3cb3bbdfead630e853919ce309378ee0335b4c2ec707857f9bb2db1a32e WatchSource:0}: Error finding container eec3b3cb3bbdfead630e853919ce309378ee0335b4c2ec707857f9bb2db1a32e: Status 404 returned error can't find the container with id eec3b3cb3bbdfead630e853919ce309378ee0335b4c2ec707857f9bb2db1a32e
Oct 30 21:06:46.409777 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:46.409734    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq" event={"ID":"7a37a736-61e4-43ba-b211-cca91fb27a37","Type":"ContainerStarted","Data":"9dc1255b87e5c28e6f1e39750b591a722eae34bde12e959b467d558f129203b4"}
Oct 30 21:06:46.410246 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:46.409794    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq" event={"ID":"7a37a736-61e4-43ba-b211-cca91fb27a37","Type":"ContainerStarted","Data":"eec3b3cb3bbdfead630e853919ce309378ee0335b4c2ec707857f9bb2db1a32e"}
Oct 30 21:06:46.430290 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:46.430238    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq" podStartSLOduration=1.43022621 podStartE2EDuration="1.43022621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:06:46.428083081 +0000 UTC m=+1617.286819374" watchObservedRunningTime="2026-10-30 21:06:46.43022621 +0000 UTC m=+1617.288962502"
Oct 30 21:06:46.800875 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:06:46.800824    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:06:47.416511 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:47.416473    6048 generic.go:356] "Generic (PLEG): container finished" podID="7a37a736-61e4-43ba-b211-cca91fb27a37" containerID="9dc1255b87e5c28e6f1e39750b591a722eae34bde12e959b467d558f129203b4" exitCode=0
Oct 30 21:06:47.416912 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:47.416560    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq" event={"ID":"7a37a736-61e4-43ba-b211-cca91fb27a37","Type":"ContainerDied","Data":"9dc1255b87e5c28e6f1e39750b591a722eae34bde12e959b467d558f129203b4"}
Oct 30 21:06:48.561494 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:48.561469    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:48.656310 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:48.656279    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7a37a736-61e4-43ba-b211-cca91fb27a37-kube-api-access-xthsh\" (UniqueName: \"kubernetes.io/projected/7a37a736-61e4-43ba-b211-cca91fb27a37-kube-api-access-xthsh\") pod \"7a37a736-61e4-43ba-b211-cca91fb27a37\" (UID: \"7a37a736-61e4-43ba-b211-cca91fb27a37\") "
Oct 30 21:06:48.656505 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:48.656411    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-openshift-ca\") pod \"7a37a736-61e4-43ba-b211-cca91fb27a37\" (UID: \"7a37a736-61e4-43ba-b211-cca91fb27a37\") "
Oct 30 21:06:48.656505 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:48.656433    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-xks-ca\") pod \"7a37a736-61e4-43ba-b211-cca91fb27a37\" (UID: \"7a37a736-61e4-43ba-b211-cca91fb27a37\") "
Oct 30 21:06:48.656761 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:48.656737    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-openshift-ca" pod "7a37a736-61e4-43ba-b211-cca91fb27a37" (UID: "7a37a736-61e4-43ba-b211-cca91fb27a37"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:06:48.658179 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:48.658156    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a37a736-61e4-43ba-b211-cca91fb27a37-kube-api-access-xthsh" pod "7a37a736-61e4-43ba-b211-cca91fb27a37" (UID: "7a37a736-61e4-43ba-b211-cca91fb27a37"). InnerVolumeSpecName "kube-api-access-xthsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:06:48.658503 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:48.658487    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-xks-ca" pod "7a37a736-61e4-43ba-b211-cca91fb27a37" (UID: "7a37a736-61e4-43ba-b211-cca91fb27a37"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:06:48.757506 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:48.757436    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:48.757506 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:48.757463    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7a37a736-61e4-43ba-b211-cca91fb27a37-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:48.757506 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:48.757474    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xthsh\" (UniqueName: \"kubernetes.io/projected/7a37a736-61e4-43ba-b211-cca91fb27a37-kube-api-access-xthsh\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:06:49.429486 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:49.429455    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"
Oct 30 21:06:49.429486 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:49.429472    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq" event={"ID":"7a37a736-61e4-43ba-b211-cca91fb27a37","Type":"ContainerDied","Data":"eec3b3cb3bbdfead630e853919ce309378ee0335b4c2ec707857f9bb2db1a32e"}
Oct 30 21:06:49.429692 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:49.429517    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eec3b3cb3bbdfead630e853919ce309378ee0335b4c2ec707857f9bb2db1a32e"
Oct 30 21:06:50.596683 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:50.596652    6048 scope.go:122] "RemoveContainer" containerID="379e3a11263aa2248c964299cbba1ab398b234594b5b2935a0ed9a29c42c7fe1"
Oct 30 21:06:50.607678 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:50.607653    6048 scope.go:122] "RemoveContainer" containerID="7ac2eff6dfdcac5be402840b68e6e26e99c3e9fcfafe4ad74aa98e05c1c307b3"
Oct 30 21:06:50.616164 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:50.616139    6048 scope.go:122] "RemoveContainer" containerID="1cd95a27a6461e60a1b24c6d8b5f3d6bba13674e870c4d4be04920f33e18364d"
Oct 30 21:06:50.625000 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:50.624980    6048 scope.go:122] "RemoveContainer" containerID="82b769221542a761616c31b2ae0cc4136c856306ed4145bfc419a45992da6ce5"
Oct 30 21:06:50.633164 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:06:50.633142    6048 scope.go:122] "RemoveContainer" containerID="434383dfb871b54ebfbee0ad4993468b343e56d7b47e0bfc0818323f600a8252"
Oct 30 21:07:00.028286 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:00.028196    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"]
Oct 30 21:07:00.038771 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:00.038733    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f45d5f1c-sp25b"]
Oct 30 21:07:01.259070 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:01.259009    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="229b2909-25f1-46df-ac6d-61837eaf3b85" path="/var/lib/kubelet/pods/229b2909-25f1-46df-ac6d-61837eaf3b85/volumes"
Oct 30 21:07:03.618427 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.618393    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"]
Oct 30 21:07:03.618911 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.618896    6048 cpu_manager.go:414] "containerMap: removing container" podUID="7a37a736-61e4-43ba-b211-cca91fb27a37" containerName="revoke-keys"
Oct 30 21:07:03.618975 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.618915    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7a37a736-61e4-43ba-b211-cca91fb27a37" containerName="revoke-keys"
Oct 30 21:07:03.619036 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.618987    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="7a37a736-61e4-43ba-b211-cca91fb27a37" containerName="revoke-keys"
Oct 30 21:07:03.623975 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.623952    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:03.629413 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.629388    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:07:03.629413 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.629386    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:07:03.632349 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.632322    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"]
Oct 30 21:07:03.698733 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.698705    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:07:03.698965 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.698948    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:07:03.739321 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.739293    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-gswsg\" (UID: \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:03.739465 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.739356    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-gswsg\" (UID: \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:03.739465 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.739451    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqf28\" (UniqueName: \"kubernetes.io/projected/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-kube-api-access-gqf28\") pod \"maas-api-revoke-sub-a4aef7d7-gswsg\" (UID: \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:03.840480 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.840448    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-gswsg\" (UID: \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:03.840643 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.840512    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-gswsg\" (UID: \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:03.840643 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.840544    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqf28\" (UniqueName: \"kubernetes.io/projected/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-kube-api-access-gqf28\") pod \"maas-api-revoke-sub-a4aef7d7-gswsg\" (UID: \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:03.841242 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.841219    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-gswsg\" (UID: \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:03.842797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.842770    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-gswsg\" (UID: \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:03.853116 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.853094    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqf28\" (UniqueName: \"kubernetes.io/projected/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-kube-api-access-gqf28\") pod \"maas-api-revoke-sub-a4aef7d7-gswsg\" (UID: \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:03.940627 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:03.940540    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:04.215869 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:04.215843    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"]
Oct 30 21:07:04.217080 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:07:04.217048    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd48ade37_a482_42a7_a9a7_4ddc92fc33b5.slice/crio-9d5cba1ca960fb07ce3c6a78588769655d3df641678fe4203c20f259f7aa9ede WatchSource:0}: Error finding container 9d5cba1ca960fb07ce3c6a78588769655d3df641678fe4203c20f259f7aa9ede: Status 404 returned error can't find the container with id 9d5cba1ca960fb07ce3c6a78588769655d3df641678fe4203c20f259f7aa9ede
Oct 30 21:07:04.557980 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:04.557948    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg" event={"ID":"d48ade37-a482-42a7-a9a7-4ddc92fc33b5","Type":"ContainerStarted","Data":"9d5cba1ca960fb07ce3c6a78588769655d3df641678fe4203c20f259f7aa9ede"}
Oct 30 21:07:05.565228 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:05.565192    6048 generic.go:356] "Generic (PLEG): container finished" podID="d48ade37-a482-42a7-a9a7-4ddc92fc33b5" containerID="9265403f98e2ff4a984e6115f98cad9ec6c320ea58eda8e19d766156768c23c1" exitCode=0
Oct 30 21:07:05.565602 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:05.565239    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg" event={"ID":"d48ade37-a482-42a7-a9a7-4ddc92fc33b5","Type":"ContainerDied","Data":"9265403f98e2ff4a984e6115f98cad9ec6c320ea58eda8e19d766156768c23c1"}
Oct 30 21:07:06.717327 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:06.717298    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:06.870976 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:06.870893    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-kube-api-access-gqf28\" (UniqueName: \"kubernetes.io/projected/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-kube-api-access-gqf28\") pod \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\" (UID: \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\") "
Oct 30 21:07:06.871163 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:06.870981    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-openshift-ca\") pod \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\" (UID: \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\") "
Oct 30 21:07:06.871163 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:06.871013    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-xks-ca\") pod \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\" (UID: \"d48ade37-a482-42a7-a9a7-4ddc92fc33b5\") "
Oct 30 21:07:06.871349 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:06.871327    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-openshift-ca" pod "d48ade37-a482-42a7-a9a7-4ddc92fc33b5" (UID: "d48ade37-a482-42a7-a9a7-4ddc92fc33b5"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:06.873120 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:06.873097    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-xks-ca" pod "d48ade37-a482-42a7-a9a7-4ddc92fc33b5" (UID: "d48ade37-a482-42a7-a9a7-4ddc92fc33b5"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:07:06.873256 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:06.873241    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-kube-api-access-gqf28" pod "d48ade37-a482-42a7-a9a7-4ddc92fc33b5" (UID: "d48ade37-a482-42a7-a9a7-4ddc92fc33b5"). InnerVolumeSpecName "kube-api-access-gqf28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:06.972002 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:06.971955    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqf28\" (UniqueName: \"kubernetes.io/projected/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-kube-api-access-gqf28\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:07:06.972002 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:06.972000    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:07:06.972002 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:06.972011    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d48ade37-a482-42a7-a9a7-4ddc92fc33b5-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:07:07.580566 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:07.580532    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"
Oct 30 21:07:07.580753 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:07.580564    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg" event={"ID":"d48ade37-a482-42a7-a9a7-4ddc92fc33b5","Type":"ContainerDied","Data":"9d5cba1ca960fb07ce3c6a78588769655d3df641678fe4203c20f259f7aa9ede"}
Oct 30 21:07:07.580753 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:07.580611    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d5cba1ca960fb07ce3c6a78588769655d3df641678fe4203c20f259f7aa9ede"
Oct 30 21:07:12.022184 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:12.022149    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"]
Oct 30 21:07:12.026786 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:12.026757    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a7b790cd-7h56g"]
Oct 30 21:07:13.029444 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:13.029405    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"]
Oct 30 21:07:13.031381 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:13.031357    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fa7ba030-mbzbg"]
Oct 30 21:07:13.257977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:13.257941    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="47eed135-fe6e-43bd-b26f-4a9fd0a98676" path="/var/lib/kubelet/pods/47eed135-fe6e-43bd-b26f-4a9fd0a98676/volumes"
Oct 30 21:07:13.258400 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:13.258385    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="722cb3b3-9f06-4c9c-bbe9-8497f8922f6f" path="/var/lib/kubelet/pods/722cb3b3-9f06-4c9c-bbe9-8497f8922f6f/volumes"
Oct 30 21:07:16.800575 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:07:16.800538    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:07:18.025925 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:18.025882    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"]
Oct 30 21:07:18.029226 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:18.029195    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d060d501-pp6t9"]
Oct 30 21:07:19.126216 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:19.126174    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gp2wl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:07:19.126895 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:19.126852    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:07:19.150063 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:19.149119    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-t97cq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:07:19.150063 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:19.149168    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:07:19.298605 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:19.298563    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="24f137da-f27d-466d-b79d-916d05a5c66b" path="/var/lib/kubelet/pods/24f137da-f27d-466d-b79d-916d05a5c66b/volumes"
Oct 30 21:07:22.323787 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.323738    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"]
Oct 30 21:07:22.324909 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.324882    6048 cpu_manager.go:414] "containerMap: removing container" podUID="d48ade37-a482-42a7-a9a7-4ddc92fc33b5" containerName="revoke-keys"
Oct 30 21:07:22.325131 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.325111    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d48ade37-a482-42a7-a9a7-4ddc92fc33b5" containerName="revoke-keys"
Oct 30 21:07:22.325351 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.325335    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="d48ade37-a482-42a7-a9a7-4ddc92fc33b5" containerName="revoke-keys"
Oct 30 21:07:22.330379 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.330354    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:22.334189 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.334157    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:07:22.334640 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.334619    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"]
Oct 30 21:07:22.335454 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.335434    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:07:22.352735 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.352701    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:07:22.352865 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.352806    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:07:22.382926 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.382898    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79805ca9-x8rd6\" (UID: \"018523cd-a21f-48df-ad49-5f1b8b5e889e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:22.383052 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.382971    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5mpq\" (UniqueName: \"kubernetes.io/projected/018523cd-a21f-48df-ad49-5f1b8b5e889e-kube-api-access-n5mpq\") pod \"maas-api-revoke-sub-79805ca9-x8rd6\" (UID: \"018523cd-a21f-48df-ad49-5f1b8b5e889e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:22.383099 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.383070    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79805ca9-x8rd6\" (UID: \"018523cd-a21f-48df-ad49-5f1b8b5e889e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:22.484152 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.484114    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79805ca9-x8rd6\" (UID: \"018523cd-a21f-48df-ad49-5f1b8b5e889e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:22.484300 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.484214    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5mpq\" (UniqueName: \"kubernetes.io/projected/018523cd-a21f-48df-ad49-5f1b8b5e889e-kube-api-access-n5mpq\") pod \"maas-api-revoke-sub-79805ca9-x8rd6\" (UID: \"018523cd-a21f-48df-ad49-5f1b8b5e889e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:22.484300 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.484242    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79805ca9-x8rd6\" (UID: \"018523cd-a21f-48df-ad49-5f1b8b5e889e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:22.484898 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.484871    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79805ca9-x8rd6\" (UID: \"018523cd-a21f-48df-ad49-5f1b8b5e889e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:22.486457 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.486434    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79805ca9-x8rd6\" (UID: \"018523cd-a21f-48df-ad49-5f1b8b5e889e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:22.496636 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.496615    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5mpq\" (UniqueName: \"kubernetes.io/projected/018523cd-a21f-48df-ad49-5f1b8b5e889e-kube-api-access-n5mpq\") pod \"maas-api-revoke-sub-79805ca9-x8rd6\" (UID: \"018523cd-a21f-48df-ad49-5f1b8b5e889e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:22.647259 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.647180    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:22.928985 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:22.928953    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"]
Oct 30 21:07:22.931187 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:07:22.931155    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018523cd_a21f_48df_ad49_5f1b8b5e889e.slice/crio-0d4b60b0b2c77923e6cf1ff307fd30893af7bfd63268ec6843f7270d67988725 WatchSource:0}: Error finding container 0d4b60b0b2c77923e6cf1ff307fd30893af7bfd63268ec6843f7270d67988725: Status 404 returned error can't find the container with id 0d4b60b0b2c77923e6cf1ff307fd30893af7bfd63268ec6843f7270d67988725
Oct 30 21:07:23.793764 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:23.793727    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6" event={"ID":"018523cd-a21f-48df-ad49-5f1b8b5e889e","Type":"ContainerStarted","Data":"47eceacf7b8ab220bf742cf8254f49e70335b2a91505d842feb20f8391136cd8"}
Oct 30 21:07:23.794241 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:23.793789    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6" event={"ID":"018523cd-a21f-48df-ad49-5f1b8b5e889e","Type":"ContainerStarted","Data":"0d4b60b0b2c77923e6cf1ff307fd30893af7bfd63268ec6843f7270d67988725"}
Oct 30 21:07:23.815092 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:23.815044    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6" podStartSLOduration=1.815017232 podStartE2EDuration="1.815017232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:07:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:07:23.812857896 +0000 UTC m=+1654.671594191" watchObservedRunningTime="2026-10-30 21:07:23.815017232 +0000 UTC m=+1654.673753522"
Oct 30 21:07:24.801379 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:24.801345    6048 generic.go:356] "Generic (PLEG): container finished" podID="018523cd-a21f-48df-ad49-5f1b8b5e889e" containerID="47eceacf7b8ab220bf742cf8254f49e70335b2a91505d842feb20f8391136cd8" exitCode=0
Oct 30 21:07:24.801802 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:24.801434    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6" event={"ID":"018523cd-a21f-48df-ad49-5f1b8b5e889e","Type":"ContainerDied","Data":"47eceacf7b8ab220bf742cf8254f49e70335b2a91505d842feb20f8391136cd8"}
Oct 30 21:07:25.935741 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:25.935716    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:26.019682 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:26.019652    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-openshift-ca\") pod \"018523cd-a21f-48df-ad49-5f1b8b5e889e\" (UID: \"018523cd-a21f-48df-ad49-5f1b8b5e889e\") "
Oct 30 21:07:26.019853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:26.019698    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-xks-ca\") pod \"018523cd-a21f-48df-ad49-5f1b8b5e889e\" (UID: \"018523cd-a21f-48df-ad49-5f1b8b5e889e\") "
Oct 30 21:07:26.019853 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:26.019812    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/018523cd-a21f-48df-ad49-5f1b8b5e889e-kube-api-access-n5mpq\" (UniqueName: \"kubernetes.io/projected/018523cd-a21f-48df-ad49-5f1b8b5e889e-kube-api-access-n5mpq\") pod \"018523cd-a21f-48df-ad49-5f1b8b5e889e\" (UID: \"018523cd-a21f-48df-ad49-5f1b8b5e889e\") "
Oct 30 21:07:26.020119 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:26.020092    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-openshift-ca" pod "018523cd-a21f-48df-ad49-5f1b8b5e889e" (UID: "018523cd-a21f-48df-ad49-5f1b8b5e889e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:26.021803 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:26.021782    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/018523cd-a21f-48df-ad49-5f1b8b5e889e-kube-api-access-n5mpq" pod "018523cd-a21f-48df-ad49-5f1b8b5e889e" (UID: "018523cd-a21f-48df-ad49-5f1b8b5e889e"). InnerVolumeSpecName "kube-api-access-n5mpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:26.021803 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:26.021795    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-xks-ca" pod "018523cd-a21f-48df-ad49-5f1b8b5e889e" (UID: "018523cd-a21f-48df-ad49-5f1b8b5e889e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:07:26.121487 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:26.121403    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5mpq\" (UniqueName: \"kubernetes.io/projected/018523cd-a21f-48df-ad49-5f1b8b5e889e-kube-api-access-n5mpq\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:07:26.121487 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:26.121442    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:07:26.121487 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:26.121457    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/018523cd-a21f-48df-ad49-5f1b8b5e889e-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:07:26.815839 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:26.815803    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6" event={"ID":"018523cd-a21f-48df-ad49-5f1b8b5e889e","Type":"ContainerDied","Data":"0d4b60b0b2c77923e6cf1ff307fd30893af7bfd63268ec6843f7270d67988725"}
Oct 30 21:07:26.815839 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:26.815841    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"
Oct 30 21:07:26.816093 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:26.815859    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d4b60b0b2c77923e6cf1ff307fd30893af7bfd63268ec6843f7270d67988725"
Oct 30 21:07:28.023333 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:28.023293    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"]
Oct 30 21:07:28.025618 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:28.025586    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dbca169a-g6hkx"]
Oct 30 21:07:29.257564 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:29.257532    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1892700d-9b18-4189-81d9-d414b98ed7d9" path="/var/lib/kubelet/pods/1892700d-9b18-4189-81d9-d414b98ed7d9/volumes"
Oct 30 21:07:40.082705 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.082672    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"]
Oct 30 21:07:40.083253 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.083234    6048 cpu_manager.go:414] "containerMap: removing container" podUID="018523cd-a21f-48df-ad49-5f1b8b5e889e" containerName="revoke-keys"
Oct 30 21:07:40.083299 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.083254    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="018523cd-a21f-48df-ad49-5f1b8b5e889e" containerName="revoke-keys"
Oct 30 21:07:40.083369 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.083360    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="018523cd-a21f-48df-ad49-5f1b8b5e889e" containerName="revoke-keys"
Oct 30 21:07:40.086443 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.086427    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:40.093152 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.093113    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:07:40.094516 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.094495    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:07:40.094668 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.094591    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:07:40.096208 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.096186    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:07:40.097527 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.097506    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"]
Oct 30 21:07:40.225388 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.225354    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0b7e8edb-4tkrb\" (UID: \"95bd1d77-bdf6-4cc7-9d97-41073964004b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:40.225388 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.225388    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfzqh\" (UniqueName: \"kubernetes.io/projected/95bd1d77-bdf6-4cc7-9d97-41073964004b-kube-api-access-sfzqh\") pod \"maas-api-revoke-sub-0b7e8edb-4tkrb\" (UID: \"95bd1d77-bdf6-4cc7-9d97-41073964004b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:40.225613 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.225417    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0b7e8edb-4tkrb\" (UID: \"95bd1d77-bdf6-4cc7-9d97-41073964004b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:40.326937 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.326898    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0b7e8edb-4tkrb\" (UID: \"95bd1d77-bdf6-4cc7-9d97-41073964004b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:40.326937 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.326935    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfzqh\" (UniqueName: \"kubernetes.io/projected/95bd1d77-bdf6-4cc7-9d97-41073964004b-kube-api-access-sfzqh\") pod \"maas-api-revoke-sub-0b7e8edb-4tkrb\" (UID: \"95bd1d77-bdf6-4cc7-9d97-41073964004b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:40.327209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.326966    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0b7e8edb-4tkrb\" (UID: \"95bd1d77-bdf6-4cc7-9d97-41073964004b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:40.327603 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.327573    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0b7e8edb-4tkrb\" (UID: \"95bd1d77-bdf6-4cc7-9d97-41073964004b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:40.329477 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.329447    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0b7e8edb-4tkrb\" (UID: \"95bd1d77-bdf6-4cc7-9d97-41073964004b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:40.339337 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.339287    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfzqh\" (UniqueName: \"kubernetes.io/projected/95bd1d77-bdf6-4cc7-9d97-41073964004b-kube-api-access-sfzqh\") pod \"maas-api-revoke-sub-0b7e8edb-4tkrb\" (UID: \"95bd1d77-bdf6-4cc7-9d97-41073964004b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:40.400894 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.400865    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:40.676766 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.676742    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"]
Oct 30 21:07:40.678619 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:07:40.678587    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bd1d77_bdf6_4cc7_9d97_41073964004b.slice/crio-affa61f686de9c5f19c2efea761c4b171f88d816c06ad2ec3810963e0b133483 WatchSource:0}: Error finding container affa61f686de9c5f19c2efea761c4b171f88d816c06ad2ec3810963e0b133483: Status 404 returned error can't find the container with id affa61f686de9c5f19c2efea761c4b171f88d816c06ad2ec3810963e0b133483
Oct 30 21:07:40.950186 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:40.950155    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb" event={"ID":"95bd1d77-bdf6-4cc7-9d97-41073964004b","Type":"ContainerStarted","Data":"affa61f686de9c5f19c2efea761c4b171f88d816c06ad2ec3810963e0b133483"}
Oct 30 21:07:41.957834 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:41.957802    6048 generic.go:356] "Generic (PLEG): container finished" podID="95bd1d77-bdf6-4cc7-9d97-41073964004b" containerID="d56edc6926e5b19a2cff3362084a2ad7d6e061dfcf19a6ac9d3e32a6c2fcdf0a" exitCode=0
Oct 30 21:07:41.958273 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:41.957886    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb" event={"ID":"95bd1d77-bdf6-4cc7-9d97-41073964004b","Type":"ContainerDied","Data":"d56edc6926e5b19a2cff3362084a2ad7d6e061dfcf19a6ac9d3e32a6c2fcdf0a"}
Oct 30 21:07:43.115953 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.115929    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:43.256880 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.256794    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95bd1d77-bdf6-4cc7-9d97-41073964004b-kube-api-access-sfzqh\" (UniqueName: \"kubernetes.io/projected/95bd1d77-bdf6-4cc7-9d97-41073964004b-kube-api-access-sfzqh\") pod \"95bd1d77-bdf6-4cc7-9d97-41073964004b\" (UID: \"95bd1d77-bdf6-4cc7-9d97-41073964004b\") "
Oct 30 21:07:43.257042 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.256916    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-xks-ca\") pod \"95bd1d77-bdf6-4cc7-9d97-41073964004b\" (UID: \"95bd1d77-bdf6-4cc7-9d97-41073964004b\") "
Oct 30 21:07:43.257042 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.256976    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-openshift-ca\") pod \"95bd1d77-bdf6-4cc7-9d97-41073964004b\" (UID: \"95bd1d77-bdf6-4cc7-9d97-41073964004b\") "
Oct 30 21:07:43.257369 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.257339    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-openshift-ca" pod "95bd1d77-bdf6-4cc7-9d97-41073964004b" (UID: "95bd1d77-bdf6-4cc7-9d97-41073964004b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:43.258890 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.258862    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95bd1d77-bdf6-4cc7-9d97-41073964004b-kube-api-access-sfzqh" pod "95bd1d77-bdf6-4cc7-9d97-41073964004b" (UID: "95bd1d77-bdf6-4cc7-9d97-41073964004b"). InnerVolumeSpecName "kube-api-access-sfzqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:43.258993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.258955    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-xks-ca" pod "95bd1d77-bdf6-4cc7-9d97-41073964004b" (UID: "95bd1d77-bdf6-4cc7-9d97-41073964004b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:07:43.358311 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.358276    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfzqh\" (UniqueName: \"kubernetes.io/projected/95bd1d77-bdf6-4cc7-9d97-41073964004b-kube-api-access-sfzqh\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:07:43.358311 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.358307    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:07:43.358311 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.358317    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/95bd1d77-bdf6-4cc7-9d97-41073964004b-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:07:43.969851 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.969810    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"
Oct 30 21:07:43.969851 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.969835    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb" event={"ID":"95bd1d77-bdf6-4cc7-9d97-41073964004b","Type":"ContainerDied","Data":"affa61f686de9c5f19c2efea761c4b171f88d816c06ad2ec3810963e0b133483"}
Oct 30 21:07:43.970107 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:43.969909    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="affa61f686de9c5f19c2efea761c4b171f88d816c06ad2ec3810963e0b133483"
Oct 30 21:07:45.022992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:45.022952    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"]
Oct 30 21:07:45.026885 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:45.026859    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-13122362-78shm"]
Oct 30 21:07:45.258125 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:45.258095    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e65fd2ab-db13-4873-b1f1-75c03dbb0891" path="/var/lib/kubelet/pods/e65fd2ab-db13-4873-b1f1-75c03dbb0891/volumes"
Oct 30 21:07:46.804973 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:07:46.804929    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:07:48.023258 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:48.023220    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"]
Oct 30 21:07:48.025187 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:48.025159    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-541c2d05-5nh5w"]
Oct 30 21:07:48.027596 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:48.027573    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"]
Oct 30 21:07:48.030461 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:48.030439    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e28e7c9-bnnst"]
Oct 30 21:07:49.258150 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:49.258116    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4008794a-54c1-42cb-b1b5-0b693853c487" path="/var/lib/kubelet/pods/4008794a-54c1-42cb-b1b5-0b693853c487/volumes"
Oct 30 21:07:49.258546 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:49.258532    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c59ef562-dd6a-4eae-bdb3-0f5657cd22ac" path="/var/lib/kubelet/pods/c59ef562-dd6a-4eae-bdb3-0f5657cd22ac/volumes"
Oct 30 21:07:50.674143 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.674108    6048 scope.go:122] "RemoveContainer" containerID="4eb80fe1cf166870c5cee1017ef5b091abef5ed0f1f151c88c2f7818cbebd092"
Oct 30 21:07:50.683495 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.683473    6048 scope.go:122] "RemoveContainer" containerID="b617be7dca36b85c61a533ddde2af4ae18f08049abfed5f35e2f54d4c7877bb7"
Oct 30 21:07:50.691600 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.691577    6048 scope.go:122] "RemoveContainer" containerID="48a0e69f87ad4ea5594f61eb550052924715facc5b37c95efb9948ae42fd2c95"
Oct 30 21:07:50.786313 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.786280    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"]
Oct 30 21:07:50.786725 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.786712    6048 cpu_manager.go:414] "containerMap: removing container" podUID="95bd1d77-bdf6-4cc7-9d97-41073964004b" containerName="revoke-keys"
Oct 30 21:07:50.786767 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.786726    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95bd1d77-bdf6-4cc7-9d97-41073964004b" containerName="revoke-keys"
Oct 30 21:07:50.786843 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.786834    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="95bd1d77-bdf6-4cc7-9d97-41073964004b" containerName="revoke-keys"
Oct 30 21:07:50.791625 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.791609    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:50.796755 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.796682    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:07:50.798656 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.798631    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:07:50.798785 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.798734    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:07:50.798847 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.798809    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:07:50.800209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.800184    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"]
Oct 30 21:07:50.939310 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.939214    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-62wt9\" (UID: \"ba14274f-3471-4f36-ad73-3a3b05b430b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:50.939310 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.939275    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-62wt9\" (UID: \"ba14274f-3471-4f36-ad73-3a3b05b430b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:50.939471 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:50.939414    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x65gk\" (UniqueName: \"kubernetes.io/projected/ba14274f-3471-4f36-ad73-3a3b05b430b2-kube-api-access-x65gk\") pod \"maas-api-revoke-sub-3d4156f1-62wt9\" (UID: \"ba14274f-3471-4f36-ad73-3a3b05b430b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:51.040389 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:51.040358    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-62wt9\" (UID: \"ba14274f-3471-4f36-ad73-3a3b05b430b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:51.040574 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:51.040401    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-62wt9\" (UID: \"ba14274f-3471-4f36-ad73-3a3b05b430b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:51.040574 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:51.040453    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x65gk\" (UniqueName: \"kubernetes.io/projected/ba14274f-3471-4f36-ad73-3a3b05b430b2-kube-api-access-x65gk\") pod \"maas-api-revoke-sub-3d4156f1-62wt9\" (UID: \"ba14274f-3471-4f36-ad73-3a3b05b430b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:51.041151 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:51.041124    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-62wt9\" (UID: \"ba14274f-3471-4f36-ad73-3a3b05b430b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:51.042626 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:51.042605    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-62wt9\" (UID: \"ba14274f-3471-4f36-ad73-3a3b05b430b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:51.052825 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:51.052800    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x65gk\" (UniqueName: \"kubernetes.io/projected/ba14274f-3471-4f36-ad73-3a3b05b430b2-kube-api-access-x65gk\") pod \"maas-api-revoke-sub-3d4156f1-62wt9\" (UID: \"ba14274f-3471-4f36-ad73-3a3b05b430b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:51.107382 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:51.107360    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:51.390569 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:51.390522    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"]
Oct 30 21:07:51.402078 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:07:51.401144    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba14274f_3471_4f36_ad73_3a3b05b430b2.slice/crio-bc60d45c72bfb04b83cdf4ddeac3eeddbe16acfda271485149143e32d4bf981c WatchSource:0}: Error finding container bc60d45c72bfb04b83cdf4ddeac3eeddbe16acfda271485149143e32d4bf981c: Status 404 returned error can't find the container with id bc60d45c72bfb04b83cdf4ddeac3eeddbe16acfda271485149143e32d4bf981c
Oct 30 21:07:52.021498 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:52.021402    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9" event={"ID":"ba14274f-3471-4f36-ad73-3a3b05b430b2","Type":"ContainerStarted","Data":"d0d43e10babee4bd464627290718b08726a4e2f73a7d0931d514e6661dd8a20e"}
Oct 30 21:07:52.021498 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:52.021461    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9" event={"ID":"ba14274f-3471-4f36-ad73-3a3b05b430b2","Type":"ContainerStarted","Data":"bc60d45c72bfb04b83cdf4ddeac3eeddbe16acfda271485149143e32d4bf981c"}
Oct 30 21:07:52.039945 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:52.039892    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9" podStartSLOduration=2.039878264 podStartE2EDuration="2.039878264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:07:52.039612626 +0000 UTC m=+1682.898348920" watchObservedRunningTime="2026-10-30 21:07:52.039878264 +0000 UTC m=+1682.898614556"
Oct 30 21:07:53.029821 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:53.029783    6048 generic.go:356] "Generic (PLEG): container finished" podID="ba14274f-3471-4f36-ad73-3a3b05b430b2" containerID="d0d43e10babee4bd464627290718b08726a4e2f73a7d0931d514e6661dd8a20e" exitCode=0
Oct 30 21:07:53.030274 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:53.029886    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9" event={"ID":"ba14274f-3471-4f36-ad73-3a3b05b430b2","Type":"ContainerDied","Data":"d0d43e10babee4bd464627290718b08726a4e2f73a7d0931d514e6661dd8a20e"}
Oct 30 21:07:54.172971 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:54.172944    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:54.275332 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:54.275303    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-openshift-ca\") pod \"ba14274f-3471-4f36-ad73-3a3b05b430b2\" (UID: \"ba14274f-3471-4f36-ad73-3a3b05b430b2\") "
Oct 30 21:07:54.275332 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:54.275338    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-xks-ca\") pod \"ba14274f-3471-4f36-ad73-3a3b05b430b2\" (UID: \"ba14274f-3471-4f36-ad73-3a3b05b430b2\") "
Oct 30 21:07:54.275600 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:54.275387    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba14274f-3471-4f36-ad73-3a3b05b430b2-kube-api-access-x65gk\" (UniqueName: \"kubernetes.io/projected/ba14274f-3471-4f36-ad73-3a3b05b430b2-kube-api-access-x65gk\") pod \"ba14274f-3471-4f36-ad73-3a3b05b430b2\" (UID: \"ba14274f-3471-4f36-ad73-3a3b05b430b2\") "
Oct 30 21:07:54.275751 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:54.275718    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-openshift-ca" pod "ba14274f-3471-4f36-ad73-3a3b05b430b2" (UID: "ba14274f-3471-4f36-ad73-3a3b05b430b2"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:54.275970 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:54.275942    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:07:54.277542 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:54.277521    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba14274f-3471-4f36-ad73-3a3b05b430b2-kube-api-access-x65gk" pod "ba14274f-3471-4f36-ad73-3a3b05b430b2" (UID: "ba14274f-3471-4f36-ad73-3a3b05b430b2"). InnerVolumeSpecName "kube-api-access-x65gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:54.277609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:54.277588    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-xks-ca" pod "ba14274f-3471-4f36-ad73-3a3b05b430b2" (UID: "ba14274f-3471-4f36-ad73-3a3b05b430b2"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:07:54.377185 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:54.377149    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ba14274f-3471-4f36-ad73-3a3b05b430b2-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:07:54.377185 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:54.377183    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x65gk\" (UniqueName: \"kubernetes.io/projected/ba14274f-3471-4f36-ad73-3a3b05b430b2-kube-api-access-x65gk\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:07:55.043484 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:55.043450    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"
Oct 30 21:07:55.043643 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:55.043484    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9" event={"ID":"ba14274f-3471-4f36-ad73-3a3b05b430b2","Type":"ContainerDied","Data":"bc60d45c72bfb04b83cdf4ddeac3eeddbe16acfda271485149143e32d4bf981c"}
Oct 30 21:07:55.043643 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:07:55.043536    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc60d45c72bfb04b83cdf4ddeac3eeddbe16acfda271485149143e32d4bf981c"
Oct 30 21:08:04.123047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:04.122143    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gp2wl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:08:04.123047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:04.122264    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:08:04.172048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:04.156121    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-t97cq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:08:04.172048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:04.156185    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:08:11.982959 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:11.982915    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"]
Oct 30 21:08:11.985197 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:11.985172    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-62wt9"]
Oct 30 21:08:12.014114 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.014082    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"]
Oct 30 21:08:12.014602 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.014584    6048 cpu_manager.go:414] "containerMap: removing container" podUID="ba14274f-3471-4f36-ad73-3a3b05b430b2" containerName="revoke-keys"
Oct 30 21:08:12.014656 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.014606    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba14274f-3471-4f36-ad73-3a3b05b430b2" containerName="revoke-keys"
Oct 30 21:08:12.014785 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.014772    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba14274f-3471-4f36-ad73-3a3b05b430b2" containerName="revoke-keys"
Oct 30 21:08:12.018346 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.018325    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:12.024231 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.024205    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:08:12.024379 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.024256    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:08:12.025335 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.025316    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:08:12.025478 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.025385    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:08:12.028640 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.028614    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"]
Oct 30 21:08:12.157165 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.157123    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-pztpq\" (UID: \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:12.157359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.157184    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-pztpq\" (UID: \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:12.157359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.157256    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dghm7\" (UniqueName: \"kubernetes.io/projected/bc022b0f-b86e-4a6e-8d33-00377d2845f4-kube-api-access-dghm7\") pod \"maas-api-revoke-sub-3d4156f1-pztpq\" (UID: \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:12.258715 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.258629    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-pztpq\" (UID: \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:12.258715 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.258686    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-pztpq\" (UID: \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:12.258715 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.258705    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dghm7\" (UniqueName: \"kubernetes.io/projected/bc022b0f-b86e-4a6e-8d33-00377d2845f4-kube-api-access-dghm7\") pod \"maas-api-revoke-sub-3d4156f1-pztpq\" (UID: \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:12.259428 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.259407    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-pztpq\" (UID: \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:12.261069 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.261043    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-pztpq\" (UID: \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:12.270907 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.270880    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dghm7\" (UniqueName: \"kubernetes.io/projected/bc022b0f-b86e-4a6e-8d33-00377d2845f4-kube-api-access-dghm7\") pod \"maas-api-revoke-sub-3d4156f1-pztpq\" (UID: \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:12.334532 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.334505    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:12.608211 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:12.608179    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"]
Oct 30 21:08:12.609883 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:08:12.609836    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc022b0f_b86e_4a6e_8d33_00377d2845f4.slice/crio-e37c7885a651feb6c49ccdb05b6f826a67d0621a769711eeec04da86be20da2c WatchSource:0}: Error finding container e37c7885a651feb6c49ccdb05b6f826a67d0621a769711eeec04da86be20da2c: Status 404 returned error can't find the container with id e37c7885a651feb6c49ccdb05b6f826a67d0621a769711eeec04da86be20da2c
Oct 30 21:08:13.226152 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:13.226115    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq" event={"ID":"bc022b0f-b86e-4a6e-8d33-00377d2845f4","Type":"ContainerStarted","Data":"e57a5de17e96e0dd253c57059cf83eee2531eff7397928da6a7d9fdf348fbde6"}
Oct 30 21:08:13.226558 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:13.226174    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq" event={"ID":"bc022b0f-b86e-4a6e-8d33-00377d2845f4","Type":"ContainerStarted","Data":"e37c7885a651feb6c49ccdb05b6f826a67d0621a769711eeec04da86be20da2c"}
Oct 30 21:08:13.246238 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:13.246187    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq" podStartSLOduration=2.246172631 podStartE2EDuration="2.246172631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:08:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:08:13.245920575 +0000 UTC m=+1704.104656869" watchObservedRunningTime="2026-10-30 21:08:13.246172631 +0000 UTC m=+1704.104908937"
Oct 30 21:08:13.257354 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:13.257330    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ba14274f-3471-4f36-ad73-3a3b05b430b2" path="/var/lib/kubelet/pods/ba14274f-3471-4f36-ad73-3a3b05b430b2/volumes"
Oct 30 21:08:14.234193 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:14.234160    6048 generic.go:356] "Generic (PLEG): container finished" podID="bc022b0f-b86e-4a6e-8d33-00377d2845f4" containerID="e57a5de17e96e0dd253c57059cf83eee2531eff7397928da6a7d9fdf348fbde6" exitCode=0
Oct 30 21:08:14.234581 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:14.234213    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq" event={"ID":"bc022b0f-b86e-4a6e-8d33-00377d2845f4","Type":"ContainerDied","Data":"e57a5de17e96e0dd253c57059cf83eee2531eff7397928da6a7d9fdf348fbde6"}
Oct 30 21:08:15.379056 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:15.379007    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:15.491621 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:15.491532    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-xks-ca\") pod \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\" (UID: \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\") "
Oct 30 21:08:15.491793 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:15.491708    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-openshift-ca\") pod \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\" (UID: \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\") "
Oct 30 21:08:15.491793 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:15.491750    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc022b0f-b86e-4a6e-8d33-00377d2845f4-kube-api-access-dghm7\" (UniqueName: \"kubernetes.io/projected/bc022b0f-b86e-4a6e-8d33-00377d2845f4-kube-api-access-dghm7\") pod \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\" (UID: \"bc022b0f-b86e-4a6e-8d33-00377d2845f4\") "
Oct 30 21:08:15.492115 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:15.492092    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-openshift-ca" pod "bc022b0f-b86e-4a6e-8d33-00377d2845f4" (UID: "bc022b0f-b86e-4a6e-8d33-00377d2845f4"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:08:15.493722 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:15.493699    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-xks-ca" pod "bc022b0f-b86e-4a6e-8d33-00377d2845f4" (UID: "bc022b0f-b86e-4a6e-8d33-00377d2845f4"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:08:15.493899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:15.493873    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc022b0f-b86e-4a6e-8d33-00377d2845f4-kube-api-access-dghm7" pod "bc022b0f-b86e-4a6e-8d33-00377d2845f4" (UID: "bc022b0f-b86e-4a6e-8d33-00377d2845f4"). InnerVolumeSpecName "kube-api-access-dghm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:08:15.593665 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:15.593627    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:08:15.593665 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:15.593659    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dghm7\" (UniqueName: \"kubernetes.io/projected/bc022b0f-b86e-4a6e-8d33-00377d2845f4-kube-api-access-dghm7\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:08:15.593665 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:15.593670    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bc022b0f-b86e-4a6e-8d33-00377d2845f4-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:08:16.247789 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:16.247760    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"
Oct 30 21:08:16.247983 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:16.247753    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq" event={"ID":"bc022b0f-b86e-4a6e-8d33-00377d2845f4","Type":"ContainerDied","Data":"e37c7885a651feb6c49ccdb05b6f826a67d0621a769711eeec04da86be20da2c"}
Oct 30 21:08:16.247983 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:16.247932    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e37c7885a651feb6c49ccdb05b6f826a67d0621a769711eeec04da86be20da2c"
Oct 30 21:08:16.800356 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:08:16.800321    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:08:36.167120 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:36.165131    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q8xpm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:08:36.167120 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:36.165213    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:08:39.032617 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:39.032576    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"]
Oct 30 21:08:39.039562 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:39.039522    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d765870-lr9r2"]
Oct 30 21:08:39.257706 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:39.257671    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="979f3391-e235-43e7-9521-b40b1e831c32" path="/var/lib/kubelet/pods/979f3391-e235-43e7-9521-b40b1e831c32/volumes"
Oct 30 21:08:46.803138 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:08:46.803052    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:08:50.653007 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.652968    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"]
Oct 30 21:08:50.653714 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.653664    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl" podUID="b9c62600-17d3-4ad2-a58f-b5579d5c8d63" containerName="discovery" containerID="cri-o://8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d" gracePeriod=30
Oct 30 21:08:50.724374 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.724343    6048 scope.go:122] "RemoveContainer" containerID="5444dc3ecec3080f52e15320f438f6ab5d56182ee22a886ae462b3650ac728b6"
Oct 30 21:08:50.768190 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.768167    6048 scope.go:122] "RemoveContainer" containerID="3c29da7ef8701f220b4dd9dd85ba83a760d312518ff85b66d5ff3983150ff2c8"
Oct 30 21:08:50.776374 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.776350    6048 scope.go:122] "RemoveContainer" containerID="9656185bab607ec86372b38f252759b789f7b4166bfaca010d44f0b707053856"
Oct 30 21:08:50.784402 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.784377    6048 scope.go:122] "RemoveContainer" containerID="e5e7d619837b2a8590d172c750ac31fd2c05eaa130cdd9610302b94af3c9b500"
Oct 30 21:08:50.792362 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.792335    6048 scope.go:122] "RemoveContainer" containerID="d30836045ab0a9dbb4ff777c5a813f9a9b85492d85cd7486fa9818c5838e9a8e"
Oct 30 21:08:50.801120 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.801101    6048 scope.go:122] "RemoveContainer" containerID="7acf9befaa9e1be4c24a59f1b07f9d9a58ce24d4ac1974a8cdc11d7254402209"
Oct 30 21:08:50.809551 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.809532    6048 scope.go:122] "RemoveContainer" containerID="6ad3a3421260188a5ecb524df473e7ae1fff9dbcbbb907559738a6bc7b433ac3"
Oct 30 21:08:50.821526 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.821426    6048 scope.go:122] "RemoveContainer" containerID="b79f77081e7f6ccbc258d398ee54320f582c34fa842bac455d8dc3ce65747f46"
Oct 30 21:08:50.833997 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.833977    6048 scope.go:122] "RemoveContainer" containerID="04db3954a130beae9a06a4ec41ea4900db53cc32e6420773f64c230e7f03abe7"
Oct 30 21:08:50.915547 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.915498    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:08:50.947728 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.947693    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-cacerts\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-cacerts\") pod \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") "
Oct 30 21:08:50.947868 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.947749    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-ca-configmap\") pod \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") "
Oct 30 21:08:50.947868 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.947786    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-kube-api-access-rz7pl\" (UniqueName: \"kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-kube-api-access-rz7pl\") pod \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") "
Oct 30 21:08:50.947868 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.947815    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-token\" (UniqueName: \"kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-token\") pod \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") "
Oct 30 21:08:50.947868 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.947850    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-dns-cert\") pod \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") "
Oct 30 21:08:50.948162 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.947911    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-kubeconfig\") pod \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") "
Oct 30 21:08:50.948230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.948194    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-ca-configmap" pod "b9c62600-17d3-4ad2-a58f-b5579d5c8d63" (UID: "b9c62600-17d3-4ad2-a58f-b5579d5c8d63"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:08:50.949053 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.949010    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-local-certs\") pod \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\" (UID: \"b9c62600-17d3-4ad2-a58f-b5579d5c8d63\") "
Oct 30 21:08:50.950538 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.950506    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-cacerts" pod "b9c62600-17d3-4ad2-a58f-b5579d5c8d63" (UID: "b9c62600-17d3-4ad2-a58f-b5579d5c8d63"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:08:50.951218 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.951191    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-token" pod "b9c62600-17d3-4ad2-a58f-b5579d5c8d63" (UID: "b9c62600-17d3-4ad2-a58f-b5579d5c8d63"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:08:50.951319 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.951237    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-kube-api-access-rz7pl" pod "b9c62600-17d3-4ad2-a58f-b5579d5c8d63" (UID: "b9c62600-17d3-4ad2-a58f-b5579d5c8d63"). InnerVolumeSpecName "kube-api-access-rz7pl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:08:50.952177 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.951942    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-kubeconfig" pod "b9c62600-17d3-4ad2-a58f-b5579d5c8d63" (UID: "b9c62600-17d3-4ad2-a58f-b5579d5c8d63"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:08:50.952177 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.952166    6048 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-cacerts\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:08:50.952338 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.952190    6048 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-ca-configmap\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:08:50.952338 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.952190    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-dns-cert" pod "b9c62600-17d3-4ad2-a58f-b5579d5c8d63" (UID: "b9c62600-17d3-4ad2-a58f-b5579d5c8d63"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:08:50.952338 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.952206    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz7pl\" (UniqueName: \"kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-kube-api-access-rz7pl\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:08:50.952338 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.952253    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:08:50.952338 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.952272    6048 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-kubeconfig\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:08:50.953525 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:50.953491    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-local-certs" pod "b9c62600-17d3-4ad2-a58f-b5579d5c8d63" (UID: "b9c62600-17d3-4ad2-a58f-b5579d5c8d63"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:08:51.053608 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:51.053572    6048 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-istio-csr-dns-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:08:51.053608 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:51.053606    6048 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c62600-17d3-4ad2-a58f-b5579d5c8d63-local-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:08:51.484764 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:51.484728    6048 generic.go:356] "Generic (PLEG): container finished" podID="b9c62600-17d3-4ad2-a58f-b5579d5c8d63" containerID="8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d" exitCode=0
Oct 30 21:08:51.484964 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:51.484784    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"
Oct 30 21:08:51.484964 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:51.484811    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl" event={"ID":"b9c62600-17d3-4ad2-a58f-b5579d5c8d63","Type":"ContainerDied","Data":"8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d"}
Oct 30 21:08:51.484964 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:51.484868    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl" event={"ID":"b9c62600-17d3-4ad2-a58f-b5579d5c8d63","Type":"ContainerDied","Data":"347b8fa402e73f31c5bf89b50ab064be6a76e75f2689a1c1a14b54a71c09389a"}
Oct 30 21:08:51.484964 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:51.484905    6048 scope.go:122] "RemoveContainer" containerID="8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d"
Oct 30 21:08:51.494499 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:51.494477    6048 scope.go:122] "RemoveContainer" containerID="8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d"
Oct 30 21:08:51.494782 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:08:51.494759    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d\": container with ID starting with 8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d not found: ID does not exist" containerID="8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d"
Oct 30 21:08:51.494884 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:51.494791    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d"} err="failed to get container status \"8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d\": rpc error: code = NotFound desc = could not find container \"8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d\": container with ID starting with 8260f6753c833d475f4ec290486a6130a5a6e1c53fb99e9a4a063d203683a86d not found: ID does not exist"
Oct 30 21:08:51.504633 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:51.504608    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"]
Oct 30 21:08:51.507789 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:51.507766    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xfgxl"]
Oct 30 21:08:53.285047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:08:53.284725    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b9c62600-17d3-4ad2-a58f-b5579d5c8d63" path="/var/lib/kubelet/pods/b9c62600-17d3-4ad2-a58f-b5579d5c8d63/volumes"
Oct 30 21:09:16.800641 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:09:16.800601    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:09:27.022037 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:09:27.021978    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"]
Oct 30 21:09:27.025051 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:09:27.025012    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-vjslj"]
Oct 30 21:09:27.258174 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:09:27.258137    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="61eb35f6-528b-4937-9ef6-071622ac2800" path="/var/lib/kubelet/pods/61eb35f6-528b-4937-9ef6-071622ac2800/volumes"
Oct 30 21:09:46.819584 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:09:46.819542    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:09:50.895515 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:09:50.895481    6048 scope.go:122] "RemoveContainer" containerID="3e444f52ef9caa93a6f7b34e8d09f2495d63a87a041d9bdf15fd415bcc10a5b9"
Oct 30 21:09:50.904206 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:09:50.904182    6048 scope.go:122] "RemoveContainer" containerID="994899eaae23f26cee847b95bf8e37267aa2d28a3e9560aa0b67e2740d004af6"
Oct 30 21:10:16.800744 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:10:16.800665    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:10:17.023626 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:10:17.023589    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"]
Oct 30 21:10:17.026427 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:10:17.026398    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-kl7fn"]
Oct 30 21:10:17.258134 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:10:17.258102    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3522396e-bf9f-4375-8805-aa416419ecb2" path="/var/lib/kubelet/pods/3522396e-bf9f-4375-8805-aa416419ecb2/volumes"
Oct 30 21:10:38.021996 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:10:38.021955    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"]
Oct 30 21:10:38.024580 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:10:38.024553    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-rspxg"]
Oct 30 21:10:39.258175 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:10:39.258142    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09257d87-0535-4506-be26-acbfa116800c" path="/var/lib/kubelet/pods/09257d87-0535-4506-be26-acbfa116800c/volumes"
Oct 30 21:10:46.803586 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:10:46.803547    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:10:50.023265 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:10:50.023227    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"]
Oct 30 21:10:50.025821 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:10:50.025797    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-hfw8z"]
Oct 30 21:10:50.932478 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:10:50.932447    6048 scope.go:122] "RemoveContainer" containerID="87fcc8cb3a15fef39042506ef4ef6dc68c752e7dcfa8ab40cc4a2870246d1eae"
Oct 30 21:10:51.257915 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:10:51.257840    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5cbb909a-45ba-444b-89b9-937aae78e0f9" path="/var/lib/kubelet/pods/5cbb909a-45ba-444b-89b9-937aae78e0f9/volumes"
Oct 30 21:11:16.800604 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:11:16.800563    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:11:18.023956 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:11:18.023906    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"]
Oct 30 21:11:18.026357 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:11:18.026322    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-jtrsq"]
Oct 30 21:11:19.258103 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:11:19.258067    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0febaa0a-61d9-41d5-85e9-b2a581aeca58" path="/var/lib/kubelet/pods/0febaa0a-61d9-41d5-85e9-b2a581aeca58/volumes"
Oct 30 21:11:28.022765 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:11:28.022727    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"]
Oct 30 21:11:28.025280 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:11:28.025254    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-d74bt"]
Oct 30 21:11:29.257989 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:11:29.257950    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4820e184-4306-457d-93ac-0c94a6a1b997" path="/var/lib/kubelet/pods/4820e184-4306-457d-93ac-0c94a6a1b997/volumes"
Oct 30 21:11:46.801961 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:11:46.801919    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:11:49.031744 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:11:49.031710    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"]
Oct 30 21:11:49.034773 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:11:49.034744    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-d49pq"]
Oct 30 21:11:49.257446 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:11:49.257412    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7a37a736-61e4-43ba-b211-cca91fb27a37" path="/var/lib/kubelet/pods/7a37a736-61e4-43ba-b211-cca91fb27a37/volumes"
Oct 30 21:11:50.953089 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:11:50.953053    6048 scope.go:122] "RemoveContainer" containerID="da05c64b94102f2a2a1f99acabfefed68b11b2c5ee2cecdce475ff84b12eaab1"
Oct 30 21:11:50.961835 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:11:50.961814    6048 scope.go:122] "RemoveContainer" containerID="9c3806da2120d458f7d338dce869f23beeb8a524c3b8253e74ad8ec987280f24"
Oct 30 21:11:50.969760 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:11:50.969738    6048 scope.go:122] "RemoveContainer" containerID="0757c49b94223f39a78b6ddd662061fe600418b34e520c02c4ccc635ecdf12b3"
Oct 30 21:12:07.027155 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:12:07.027107    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"]
Oct 30 21:12:07.029748 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:12:07.029724    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-gswsg"]
Oct 30 21:12:07.258786 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:12:07.258746    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d48ade37-a482-42a7-a9a7-4ddc92fc33b5" path="/var/lib/kubelet/pods/d48ade37-a482-42a7-a9a7-4ddc92fc33b5/volumes"
Oct 30 21:12:16.801252 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:12:16.801216    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:12:26.040051 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:12:26.039999    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"]
Oct 30 21:12:26.052587 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:12:26.052560    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-x8rd6"]
Oct 30 21:12:27.257895 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:12:27.257860    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="018523cd-a21f-48df-ad49-5f1b8b5e889e" path="/var/lib/kubelet/pods/018523cd-a21f-48df-ad49-5f1b8b5e889e/volumes"
Oct 30 21:12:44.050741 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:12:44.050701    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"]
Oct 30 21:12:44.054468 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:12:44.054429    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0b7e8edb-4tkrb"]
Oct 30 21:12:45.257656 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:12:45.257621    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="95bd1d77-bdf6-4cc7-9d97-41073964004b" path="/var/lib/kubelet/pods/95bd1d77-bdf6-4cc7-9d97-41073964004b/volumes"
Oct 30 21:12:46.805198 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:12:46.805164    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:12:50.998426 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:12:50.998393    6048 scope.go:122] "RemoveContainer" containerID="12eeec63abf4ca5884c8c947e6f2a242744de511560f31abf2bb4d39d50dbec7"
Oct 30 21:12:51.007096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:12:51.007078    6048 scope.go:122] "RemoveContainer" containerID="9dc1255b87e5c28e6f1e39750b591a722eae34bde12e959b467d558f129203b4"
Oct 30 21:12:51.014758 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:12:51.014740    6048 scope.go:122] "RemoveContainer" containerID="451e171fbeddd2434528330590c5417150a06bda944ef69cc6f0bc503cfa8634"
Oct 30 21:13:16.023700 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:13:16.023662    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"]
Oct 30 21:13:16.026104 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:13:16.026063    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pztpq"]
Oct 30 21:13:16.800511 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:13:16.800469    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:13:17.257360 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:13:17.257320    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc022b0f-b86e-4a6e-8d33-00377d2845f4" path="/var/lib/kubelet/pods/bc022b0f-b86e-4a6e-8d33-00377d2845f4/volumes"
Oct 30 21:13:46.805597 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:13:46.805480    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:13:51.041879 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:13:51.041848    6048 scope.go:122] "RemoveContainer" containerID="d56edc6926e5b19a2cff3362084a2ad7d6e061dfcf19a6ac9d3e32a6c2fcdf0a"
Oct 30 21:13:51.050381 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:13:51.050355    6048 scope.go:122] "RemoveContainer" containerID="47eceacf7b8ab220bf742cf8254f49e70335b2a91505d842feb20f8391136cd8"
Oct 30 21:13:51.058165 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:13:51.058149    6048 scope.go:122] "RemoveContainer" containerID="9265403f98e2ff4a984e6115f98cad9ec6c320ea58eda8e19d766156768c23c1"
Oct 30 21:14:09.555520 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.555485    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"]
Oct 30 21:14:09.555979 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.555900    6048 cpu_manager.go:414] "containerMap: removing container" podUID="b9c62600-17d3-4ad2-a58f-b5579d5c8d63" containerName="discovery"
Oct 30 21:14:09.555979 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.555912    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9c62600-17d3-4ad2-a58f-b5579d5c8d63" containerName="discovery"
Oct 30 21:14:09.555979 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.555943    6048 cpu_manager.go:414] "containerMap: removing container" podUID="bc022b0f-b86e-4a6e-8d33-00377d2845f4" containerName="revoke-keys"
Oct 30 21:14:09.555979 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.555948    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc022b0f-b86e-4a6e-8d33-00377d2845f4" containerName="revoke-keys"
Oct 30 21:14:09.556197 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.556016    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc022b0f-b86e-4a6e-8d33-00377d2845f4" containerName="revoke-keys"
Oct 30 21:14:09.556197 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.556045    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9c62600-17d3-4ad2-a58f-b5579d5c8d63" containerName="discovery"
Oct 30 21:14:09.560943 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.560922    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:09.564936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.564911    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:14:09.566103 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.566086    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:14:09.566171 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.566136    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:14:09.566237 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.566224    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:14:09.577639 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.577617    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"]
Oct 30 21:14:09.717769 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.717737    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mggqs\" (UniqueName: \"kubernetes.io/projected/1ec4bd43-c724-49fe-925b-7629fc2d9a53-kube-api-access-mggqs\") pod \"maas-api-revoke-sub-3d4156f1-pbtj8\" (UID: \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:09.717933 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.717776    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-pbtj8\" (UID: \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:09.717933 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.717872    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-pbtj8\" (UID: \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:09.819083 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.819054    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mggqs\" (UniqueName: \"kubernetes.io/projected/1ec4bd43-c724-49fe-925b-7629fc2d9a53-kube-api-access-mggqs\") pod \"maas-api-revoke-sub-3d4156f1-pbtj8\" (UID: \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:09.819262 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.819094    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-pbtj8\" (UID: \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:09.819262 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.819137    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-pbtj8\" (UID: \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:09.819792 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.819769    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-pbtj8\" (UID: \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:09.821547 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.821518    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-pbtj8\" (UID: \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:09.832350 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.832324    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mggqs\" (UniqueName: \"kubernetes.io/projected/1ec4bd43-c724-49fe-925b-7629fc2d9a53-kube-api-access-mggqs\") pod \"maas-api-revoke-sub-3d4156f1-pbtj8\" (UID: \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:09.873872 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:09.873845    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:10.148375 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:10.148336    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"]
Oct 30 21:14:10.151119 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:14:10.151093    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec4bd43_c724_49fe_925b_7629fc2d9a53.slice/crio-246aa1aafeaf7babc351ce8073bd8a5a7c2c2686051d3cdf5063f79d3745c17b WatchSource:0}: Error finding container 246aa1aafeaf7babc351ce8073bd8a5a7c2c2686051d3cdf5063f79d3745c17b: Status 404 returned error can't find the container with id 246aa1aafeaf7babc351ce8073bd8a5a7c2c2686051d3cdf5063f79d3745c17b
Oct 30 21:14:10.241464 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:10.241424    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8" event={"ID":"1ec4bd43-c724-49fe-925b-7629fc2d9a53","Type":"ContainerStarted","Data":"246aa1aafeaf7babc351ce8073bd8a5a7c2c2686051d3cdf5063f79d3745c17b"}
Oct 30 21:14:11.247194 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:11.247158    6048 generic.go:356] "Generic (PLEG): container finished" podID="1ec4bd43-c724-49fe-925b-7629fc2d9a53" containerID="da50f287647feede7b545b83593d9204144f4ec25ee27626b0313baa2429caa4" exitCode=0
Oct 30 21:14:11.247583 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:11.247237    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8" event={"ID":"1ec4bd43-c724-49fe-925b-7629fc2d9a53","Type":"ContainerDied","Data":"da50f287647feede7b545b83593d9204144f4ec25ee27626b0313baa2429caa4"}
Oct 30 21:14:12.392446 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:12.392419    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:12.445369 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:12.445335    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-xks-ca\") pod \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\" (UID: \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\") "
Oct 30 21:14:12.445516 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:12.445380    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ec4bd43-c724-49fe-925b-7629fc2d9a53-kube-api-access-mggqs\" (UniqueName: \"kubernetes.io/projected/1ec4bd43-c724-49fe-925b-7629fc2d9a53-kube-api-access-mggqs\") pod \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\" (UID: \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\") "
Oct 30 21:14:12.445516 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:12.445435    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-openshift-ca\") pod \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\" (UID: \"1ec4bd43-c724-49fe-925b-7629fc2d9a53\") "
Oct 30 21:14:12.445842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:12.445821    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-openshift-ca" pod "1ec4bd43-c724-49fe-925b-7629fc2d9a53" (UID: "1ec4bd43-c724-49fe-925b-7629fc2d9a53"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:12.447583 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:12.447532    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-xks-ca" pod "1ec4bd43-c724-49fe-925b-7629fc2d9a53" (UID: "1ec4bd43-c724-49fe-925b-7629fc2d9a53"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:14:12.447691 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:12.447591    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ec4bd43-c724-49fe-925b-7629fc2d9a53-kube-api-access-mggqs" pod "1ec4bd43-c724-49fe-925b-7629fc2d9a53" (UID: "1ec4bd43-c724-49fe-925b-7629fc2d9a53"). InnerVolumeSpecName "kube-api-access-mggqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:12.547073 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:12.546971    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:12.547073 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:12.547003    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mggqs\" (UniqueName: \"kubernetes.io/projected/1ec4bd43-c724-49fe-925b-7629fc2d9a53-kube-api-access-mggqs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:12.547073 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:12.547013    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1ec4bd43-c724-49fe-925b-7629fc2d9a53-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:13.259016 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:13.258978    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8" event={"ID":"1ec4bd43-c724-49fe-925b-7629fc2d9a53","Type":"ContainerDied","Data":"246aa1aafeaf7babc351ce8073bd8a5a7c2c2686051d3cdf5063f79d3745c17b"}
Oct 30 21:14:13.259209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:13.259045    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="246aa1aafeaf7babc351ce8073bd8a5a7c2c2686051d3cdf5063f79d3745c17b"
Oct 30 21:14:13.259209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:13.259078    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"
Oct 30 21:14:16.800386 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:14:16.800345    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:14:25.927833 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:25.927795    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"]
Oct 30 21:14:25.928256 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:25.928017    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy" containerID="cri-o://d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960" gracePeriod=30
Oct 30 21:14:25.934548 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:25.934508    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"]
Oct 30 21:14:25.934739 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:25.934718    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerName="istio-proxy" containerID="cri-o://0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147" gracePeriod=30
Oct 30 21:14:25.935856 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:25.935832    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"]
Oct 30 21:14:25.936069 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:25.936032    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy" containerID="cri-o://ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df" gracePeriod=30
Oct 30 21:14:25.937038 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:25.936996    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"]
Oct 30 21:14:25.937215 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:25.937187    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy" containerID="cri-o://61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2" gracePeriod=30
Oct 30 21:14:31.235852 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.235826    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 21:14:31.243420 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.243313    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 21:14:31.261429 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.261006    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:14:31.268593 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.268567    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 21:14:31.377765 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.377732    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5eeecf4c-4044-477d-8e01-9084d00a00cd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eeecf4c-4044-477d-8e01-9084d00a00cd-istiod-ca-cert\") pod \"5eeecf4c-4044-477d-8e01-9084d00a00cd\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") "
Oct 30 21:14:31.377765 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.377771    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-data\") pod \"587eaac8-4b77-4770-962f-844e6887a4ac\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") "
Oct 30 21:14:31.378040 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.377803    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-token\" (UniqueName: \"kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-token\") pod \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") "
Oct 30 21:14:31.378040 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.377832    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-socket\") pod \"551ccd40-6ea1-451e-ade9-861cb41ff304\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") "
Oct 30 21:14:31.378040 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.377861    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-envoy\") pod \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") "
Oct 30 21:14:31.378040 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.377890    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-certs\") pod \"5eeecf4c-4044-477d-8e01-9084d00a00cd\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") "
Oct 30 21:14:31.378040 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.377931    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-podinfo\") pod \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") "
Oct 30 21:14:31.378040 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.377959    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-certs\") pod \"551ccd40-6ea1-451e-ade9-861cb41ff304\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") "
Oct 30 21:14:31.378366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378117    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-data" pod "587eaac8-4b77-4770-962f-844e6887a4ac" (UID: "587eaac8-4b77-4770-962f-844e6887a4ac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.378366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378185    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/587eaac8-4b77-4770-962f-844e6887a4ac-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/587eaac8-4b77-4770-962f-844e6887a4ac-istio-podinfo\") pod \"587eaac8-4b77-4770-962f-844e6887a4ac\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") "
Oct 30 21:14:31.378366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378185    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-socket" pod "551ccd40-6ea1-451e-ade9-861cb41ff304" (UID: "551ccd40-6ea1-451e-ade9-861cb41ff304"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.378366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378199    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-certs" pod "551ccd40-6ea1-451e-ade9-861cb41ff304" (UID: "551ccd40-6ea1-451e-ade9-861cb41ff304"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.378366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378221    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-credential-socket\") pod \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") "
Oct 30 21:14:31.378366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378251    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-kube-api-access-c8rds\" (UniqueName: \"kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-kube-api-access-c8rds\") pod \"587eaac8-4b77-4770-962f-844e6887a4ac\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") "
Oct 30 21:14:31.378366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378289    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-credential-socket\") pod \"5eeecf4c-4044-477d-8e01-9084d00a00cd\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") "
Oct 30 21:14:31.378366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378337    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istiod-ca-cert\") pod \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") "
Oct 30 21:14:31.378366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378368    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-data\") pod \"551ccd40-6ea1-451e-ade9-861cb41ff304\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") "
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378408    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-podinfo\") pod \"551ccd40-6ea1-451e-ade9-861cb41ff304\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") "
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378409    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-certs" pod "5eeecf4c-4044-477d-8e01-9084d00a00cd" (UID: "5eeecf4c-4044-477d-8e01-9084d00a00cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378426    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-credential-socket" pod "a9fdb83e-0e08-4749-b33d-6cc1eb189791" (UID: "a9fdb83e-0e08-4749-b33d-6cc1eb189791"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378471    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-credential-socket\") pod \"551ccd40-6ea1-451e-ade9-861cb41ff304\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") "
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378503    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/587eaac8-4b77-4770-962f-844e6887a4ac-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/587eaac8-4b77-4770-962f-844e6887a4ac-istiod-ca-cert\") pod \"587eaac8-4b77-4770-962f-844e6887a4ac\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") "
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378572    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-data\") pod \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") "
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378603    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-kube-api-access-khzgj\" (UniqueName: \"kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-kube-api-access-khzgj\") pod \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") "
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378630    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-envoy\") pod \"587eaac8-4b77-4770-962f-844e6887a4ac\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") "
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378678    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-kube-api-access-c7l9r\" (UniqueName: \"kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-kube-api-access-c7l9r\") pod \"551ccd40-6ea1-451e-ade9-861cb41ff304\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") "
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378691    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-data" pod "551ccd40-6ea1-451e-ade9-861cb41ff304" (UID: "551ccd40-6ea1-451e-ade9-861cb41ff304"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378703    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/551ccd40-6ea1-451e-ade9-861cb41ff304-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/551ccd40-6ea1-451e-ade9-861cb41ff304-istiod-ca-cert\") pod \"551ccd40-6ea1-451e-ade9-861cb41ff304\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") "
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378722    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eeecf4c-4044-477d-8e01-9084d00a00cd-istiod-ca-cert" pod "5eeecf4c-4044-477d-8e01-9084d00a00cd" (UID: "5eeecf4c-4044-477d-8e01-9084d00a00cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378736    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-token\" (UniqueName: \"kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-token\") pod \"551ccd40-6ea1-451e-ade9-861cb41ff304\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") "
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378769    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-kube-api-access-4zk59\" (UniqueName: \"kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-kube-api-access-4zk59\") pod \"5eeecf4c-4044-477d-8e01-9084d00a00cd\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") "
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378801    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-token\" (UniqueName: \"kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-token\") pod \"5eeecf4c-4044-477d-8e01-9084d00a00cd\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") "
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378825    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istiod-ca-cert" pod "a9fdb83e-0e08-4749-b33d-6cc1eb189791" (UID: "a9fdb83e-0e08-4749-b33d-6cc1eb189791"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:31.378842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378830    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-credential-socket\") pod \"587eaac8-4b77-4770-962f-844e6887a4ac\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") "
Oct 30 21:14:31.379743 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378876    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-podinfo\") pod \"5eeecf4c-4044-477d-8e01-9084d00a00cd\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") "
Oct 30 21:14:31.379743 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378902    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-socket\") pod \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") "
Oct 30 21:14:31.379743 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378939    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-envoy\") pod \"551ccd40-6ea1-451e-ade9-861cb41ff304\" (UID: \"551ccd40-6ea1-451e-ade9-861cb41ff304\") "
Oct 30 21:14:31.379743 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378971    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-envoy\") pod \"5eeecf4c-4044-477d-8e01-9084d00a00cd\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") "
Oct 30 21:14:31.379743 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379000    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-certs\") pod \"587eaac8-4b77-4770-962f-844e6887a4ac\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") "
Oct 30 21:14:31.379743 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379055    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-istio-token\" (UniqueName: \"kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-istio-token\") pod \"587eaac8-4b77-4770-962f-844e6887a4ac\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") "
Oct 30 21:14:31.379743 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379084    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-socket\") pod \"587eaac8-4b77-4770-962f-844e6887a4ac\" (UID: \"587eaac8-4b77-4770-962f-844e6887a4ac\") "
Oct 30 21:14:31.379743 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379129    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-data\") pod \"5eeecf4c-4044-477d-8e01-9084d00a00cd\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") "
Oct 30 21:14:31.379743 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379178    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-certs\") pod \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\" (UID: \"a9fdb83e-0e08-4749-b33d-6cc1eb189791\") "
Oct 30 21:14:31.379743 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379213    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-socket\") pod \"5eeecf4c-4044-477d-8e01-9084d00a00cd\" (UID: \"5eeecf4c-4044-477d-8e01-9084d00a00cd\") "
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.378939    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-data" pod "a9fdb83e-0e08-4749-b33d-6cc1eb189791" (UID: "a9fdb83e-0e08-4749-b33d-6cc1eb189791"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379118    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-credential-socket" pod "5eeecf4c-4044-477d-8e01-9084d00a00cd" (UID: "5eeecf4c-4044-477d-8e01-9084d00a00cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379279    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/587eaac8-4b77-4770-962f-844e6887a4ac-istiod-ca-cert" pod "587eaac8-4b77-4770-962f-844e6887a4ac" (UID: "587eaac8-4b77-4770-962f-844e6887a4ac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379345    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-credential-socket" pod "587eaac8-4b77-4770-962f-844e6887a4ac" (UID: "587eaac8-4b77-4770-962f-844e6887a4ac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379567    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-credential-socket" pod "551ccd40-6ea1-451e-ade9-861cb41ff304" (UID: "551ccd40-6ea1-451e-ade9-861cb41ff304"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379784    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-socket" pod "587eaac8-4b77-4770-962f-844e6887a4ac" (UID: "587eaac8-4b77-4770-962f-844e6887a4ac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379796    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-data" pod "5eeecf4c-4044-477d-8e01-9084d00a00cd" (UID: "5eeecf4c-4044-477d-8e01-9084d00a00cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.379840    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-certs" pod "a9fdb83e-0e08-4749-b33d-6cc1eb189791" (UID: "a9fdb83e-0e08-4749-b33d-6cc1eb189791"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.380143    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-socket" pod "a9fdb83e-0e08-4749-b33d-6cc1eb189791" (UID: "a9fdb83e-0e08-4749-b33d-6cc1eb189791"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.380598    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/551ccd40-6ea1-451e-ade9-861cb41ff304-istiod-ca-cert" pod "551ccd40-6ea1-451e-ade9-861cb41ff304" (UID: "551ccd40-6ea1-451e-ade9-861cb41ff304"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.381156    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-certs" pod "587eaac8-4b77-4770-962f-844e6887a4ac" (UID: "587eaac8-4b77-4770-962f-844e6887a4ac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.381573    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-socket" pod "5eeecf4c-4044-477d-8e01-9084d00a00cd" (UID: "5eeecf4c-4044-477d-8e01-9084d00a00cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382121    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-podinfo" pod "a9fdb83e-0e08-4749-b33d-6cc1eb189791" (UID: "a9fdb83e-0e08-4749-b33d-6cc1eb189791"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382592    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382616    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382632    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382648    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382665    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382683    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382699    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382714    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/587eaac8-4b77-4770-962f-844e6887a4ac-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382728    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382742    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/551ccd40-6ea1-451e-ade9-861cb41ff304-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382755    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382769    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382783    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382797    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382811    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382825    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382843    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382856    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eeecf4c-4044-477d-8e01-9084d00a00cd-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382871    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382885    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.383649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.382900    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.384769    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-kube-api-access-c7l9r" pod "551ccd40-6ea1-451e-ade9-861cb41ff304" (UID: "551ccd40-6ea1-451e-ade9-861cb41ff304"). InnerVolumeSpecName "kube-api-access-c7l9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.384891    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-token" pod "551ccd40-6ea1-451e-ade9-861cb41ff304" (UID: "551ccd40-6ea1-451e-ade9-861cb41ff304"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.384893    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-podinfo" pod "5eeecf4c-4044-477d-8e01-9084d00a00cd" (UID: "5eeecf4c-4044-477d-8e01-9084d00a00cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.384942    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-envoy" pod "587eaac8-4b77-4770-962f-844e6887a4ac" (UID: "587eaac8-4b77-4770-962f-844e6887a4ac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.385008    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-kube-api-access-khzgj" pod "a9fdb83e-0e08-4749-b33d-6cc1eb189791" (UID: "a9fdb83e-0e08-4749-b33d-6cc1eb189791"). InnerVolumeSpecName "kube-api-access-khzgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.385060    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-istio-token" pod "587eaac8-4b77-4770-962f-844e6887a4ac" (UID: "587eaac8-4b77-4770-962f-844e6887a4ac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.385086    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-kube-api-access-c8rds" pod "587eaac8-4b77-4770-962f-844e6887a4ac" (UID: "587eaac8-4b77-4770-962f-844e6887a4ac"). InnerVolumeSpecName "kube-api-access-c8rds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.385144    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-token" pod "5eeecf4c-4044-477d-8e01-9084d00a00cd" (UID: "5eeecf4c-4044-477d-8e01-9084d00a00cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.385201    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-envoy" pod "a9fdb83e-0e08-4749-b33d-6cc1eb189791" (UID: "a9fdb83e-0e08-4749-b33d-6cc1eb189791"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.385230    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-podinfo" pod "551ccd40-6ea1-451e-ade9-861cb41ff304" (UID: "551ccd40-6ea1-451e-ade9-861cb41ff304"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.385412    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/587eaac8-4b77-4770-962f-844e6887a4ac-istio-podinfo" pod "587eaac8-4b77-4770-962f-844e6887a4ac" (UID: "587eaac8-4b77-4770-962f-844e6887a4ac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.385420    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-token" pod "a9fdb83e-0e08-4749-b33d-6cc1eb189791" (UID: "a9fdb83e-0e08-4749-b33d-6cc1eb189791"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.385609 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.385441    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-envoy" pod "551ccd40-6ea1-451e-ade9-861cb41ff304" (UID: "551ccd40-6ea1-451e-ade9-861cb41ff304"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.386079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.385687    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-kube-api-access-4zk59" pod "5eeecf4c-4044-477d-8e01-9084d00a00cd" (UID: "5eeecf4c-4044-477d-8e01-9084d00a00cd"). InnerVolumeSpecName "kube-api-access-4zk59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:31.386079 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.385914    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-envoy" pod "5eeecf4c-4044-477d-8e01-9084d00a00cd" (UID: "5eeecf4c-4044-477d-8e01-9084d00a00cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:14:31.403295 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.403270    6048 generic.go:356] "Generic (PLEG): container finished" podID="587eaac8-4b77-4770-962f-844e6887a4ac" containerID="d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960" exitCode=0
Oct 30 21:14:31.403404 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.403330    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"
Oct 30 21:14:31.403404 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.403350    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" event={"ID":"587eaac8-4b77-4770-962f-844e6887a4ac","Type":"ContainerDied","Data":"d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960"}
Oct 30 21:14:31.403498 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.403428    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq" event={"ID":"587eaac8-4b77-4770-962f-844e6887a4ac","Type":"ContainerDied","Data":"55bd77b4610bbe6fa48160c47d3d8fac6075f768225e5fd16b6a4c35482058c7"}
Oct 30 21:14:31.403498 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.403453    6048 scope.go:122] "RemoveContainer" containerID="d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960"
Oct 30 21:14:31.404911 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.404889    6048 generic.go:356] "Generic (PLEG): container finished" podID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerID="0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147" exitCode=0
Oct 30 21:14:31.405002 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.404967    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"
Oct 30 21:14:31.405002 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.404972    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" event={"ID":"551ccd40-6ea1-451e-ade9-861cb41ff304","Type":"ContainerDied","Data":"0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147"}
Oct 30 21:14:31.405117 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.405047    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g" event={"ID":"551ccd40-6ea1-451e-ade9-861cb41ff304","Type":"ContainerDied","Data":"ebc5d40d7930a924e340db7dc8d2e34df4796780912d203445015e1747075bd4"}
Oct 30 21:14:31.406504 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.406461    6048 generic.go:356] "Generic (PLEG): container finished" podID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerID="ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df" exitCode=0
Oct 30 21:14:31.406504 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.406489    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" event={"ID":"a9fdb83e-0e08-4749-b33d-6cc1eb189791","Type":"ContainerDied","Data":"ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df"}
Oct 30 21:14:31.406665 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.406526    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"
Oct 30 21:14:31.406665 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.406533    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm" event={"ID":"a9fdb83e-0e08-4749-b33d-6cc1eb189791","Type":"ContainerDied","Data":"1c4e6dd12aa22979e3c5c630749234d187dcebad037450e2eac43cebe31e4416"}
Oct 30 21:14:31.408644 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.408575    6048 generic.go:356] "Generic (PLEG): container finished" podID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerID="61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2" exitCode=0
Oct 30 21:14:31.408644 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.408603    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" event={"ID":"5eeecf4c-4044-477d-8e01-9084d00a00cd","Type":"ContainerDied","Data":"61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2"}
Oct 30 21:14:31.408644 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.408644    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl" event={"ID":"5eeecf4c-4044-477d-8e01-9084d00a00cd","Type":"ContainerDied","Data":"02d7f782ea5d5dba5df23b579b018539531e1a8585f82bb289fe7fe85201c519"}
Oct 30 21:14:31.408806 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.408649    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"
Oct 30 21:14:31.415826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.415803    6048 scope.go:122] "RemoveContainer" containerID="d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960"
Oct 30 21:14:31.416151 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:14:31.416132    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960\": container with ID starting with d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960 not found: ID does not exist" containerID="d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960"
Oct 30 21:14:31.416227 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.416159    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960"} err="failed to get container status \"d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960\": rpc error: code = NotFound desc = could not find container \"d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960\": container with ID starting with d6c61a97687b7b78d88c16ca8a35d28c4520729f1600f1872e0a559d37209960 not found: ID does not exist"
Oct 30 21:14:31.416227 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.416176    6048 scope.go:122] "RemoveContainer" containerID="0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147"
Oct 30 21:14:31.425072 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.425048    6048 scope.go:122] "RemoveContainer" containerID="0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147"
Oct 30 21:14:31.425304 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:14:31.425283    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147\": container with ID starting with 0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147 not found: ID does not exist" containerID="0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147"
Oct 30 21:14:31.425380 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.425310    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147"} err="failed to get container status \"0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147\": rpc error: code = NotFound desc = could not find container \"0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147\": container with ID starting with 0e16e45a1e02319b9aef8480ab6fd7535b04ac92622310432a1ccdd51f83d147 not found: ID does not exist"
Oct 30 21:14:31.425380 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.425339    6048 scope.go:122] "RemoveContainer" containerID="ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df"
Oct 30 21:14:31.433776 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.433753    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"]
Oct 30 21:14:31.435582 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.435564    6048 scope.go:122] "RemoveContainer" containerID="ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df"
Oct 30 21:14:31.435825 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:14:31.435805    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df\": container with ID starting with ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df not found: ID does not exist" containerID="ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df"
Oct 30 21:14:31.435871 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.435833    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df"} err="failed to get container status \"ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df\": rpc error: code = NotFound desc = could not find container \"ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df\": container with ID starting with ad1da879e331afb980e6f54173adb9a1f426c10c6c27944cb82a1c8352c176df not found: ID does not exist"
Oct 30 21:14:31.435871 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.435855    6048 scope.go:122] "RemoveContainer" containerID="61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2"
Oct 30 21:14:31.440089 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.440068    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-t97cq"]
Oct 30 21:14:31.444627 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.444610    6048 scope.go:122] "RemoveContainer" containerID="61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2"
Oct 30 21:14:31.444898 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:14:31.444878    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2\": container with ID starting with 61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2 not found: ID does not exist" containerID="61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2"
Oct 30 21:14:31.444963 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.444909    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2"} err="failed to get container status \"61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2\": rpc error: code = NotFound desc = could not find container \"61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2\": container with ID starting with 61426859b4f23f262e54b1e5280258f8a0d730c4e0072de90aa4af55d20381e2 not found: ID does not exist"
Oct 30 21:14:31.452592 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.452569    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"]
Oct 30 21:14:31.456717 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.456696    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gp2wl"]
Oct 30 21:14:31.468348 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.468324    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"]
Oct 30 21:14:31.474914 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.474862    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q8xpm"]
Oct 30 21:14:31.483881 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483862    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khzgj\" (UniqueName: \"kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-kube-api-access-khzgj\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.483951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483883    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/587eaac8-4b77-4770-962f-844e6887a4ac-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.483951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483895    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7l9r\" (UniqueName: \"kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-kube-api-access-c7l9r\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.483951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483904    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.483951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483912    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zk59\" (UniqueName: \"kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-kube-api-access-4zk59\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.483951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483920    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.483951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483928    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.483951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483936    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.483951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483945    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eeecf4c-4044-477d-8e01-9084d00a00cd-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.483951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483953    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.484269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483961    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.484269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483970    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9fdb83e-0e08-4749-b33d-6cc1eb189791-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.484269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483978    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/587eaac8-4b77-4770-962f-844e6887a4ac-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.484269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.483992    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8rds\" (UniqueName: \"kubernetes.io/projected/587eaac8-4b77-4770-962f-844e6887a4ac-kube-api-access-c8rds\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.484269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.484001    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/551ccd40-6ea1-451e-ade9-861cb41ff304-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:14:31.491681 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.491661    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"]
Oct 30 21:14:31.496993 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:31.496971    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-p9h5g"]
Oct 30 21:14:33.116800 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.116761    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"]
Oct 30 21:14:33.117376 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117354    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy"
Oct 30 21:14:33.117476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117380    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy"
Oct 30 21:14:33.117476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117401    6048 cpu_manager.go:414] "containerMap: removing container" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerName="istio-proxy"
Oct 30 21:14:33.117476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117409    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerName="istio-proxy"
Oct 30 21:14:33.117476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117426    6048 cpu_manager.go:414] "containerMap: removing container" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy"
Oct 30 21:14:33.117476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117434    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy"
Oct 30 21:14:33.117721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117477    6048 cpu_manager.go:414] "containerMap: removing container" podUID="1ec4bd43-c724-49fe-925b-7629fc2d9a53" containerName="revoke-keys"
Oct 30 21:14:33.117721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117486    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ec4bd43-c724-49fe-925b-7629fc2d9a53" containerName="revoke-keys"
Oct 30 21:14:33.117721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117505    6048 cpu_manager.go:414] "containerMap: removing container" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy"
Oct 30 21:14:33.117721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117512    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy"
Oct 30 21:14:33.117721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117597    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ec4bd43-c724-49fe-925b-7629fc2d9a53" containerName="revoke-keys"
Oct 30 21:14:33.117721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117611    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" containerName="istio-proxy"
Oct 30 21:14:33.117721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117624    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" containerName="istio-proxy"
Oct 30 21:14:33.117721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117635    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" containerName="istio-proxy"
Oct 30 21:14:33.117721 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.117645    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" containerName="istio-proxy"
Oct 30 21:14:33.122703 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.122677    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.131218 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.130550    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 21:14:33.131771 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.131749    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:14:33.131771 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.131762    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-49a6a4-serving-cert\""
Oct 30 21:14:33.131970 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.131794    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-57jm5\""
Oct 30 21:14:33.133745 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.133723    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"]
Oct 30 21:14:33.200990 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.200948    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-metrics-certs\") pod \"maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.201209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.201001    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69d74\" (UniqueName: \"kubernetes.io/projected/69ee6c43-664f-4cd4-995c-30312b7ad2e1-kube-api-access-69d74\") pod \"maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.201209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.201131    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.201340 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.201289    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ee6c43-664f-4cd4-995c-30312b7ad2e1-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.208863 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.208839    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:14:33.258185 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.258143    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="551ccd40-6ea1-451e-ade9-861cb41ff304" path="/var/lib/kubelet/pods/551ccd40-6ea1-451e-ade9-861cb41ff304/volumes"
Oct 30 21:14:33.258674 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.258652    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="587eaac8-4b77-4770-962f-844e6887a4ac" path="/var/lib/kubelet/pods/587eaac8-4b77-4770-962f-844e6887a4ac/volumes"
Oct 30 21:14:33.259129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.259111    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5eeecf4c-4044-477d-8e01-9084d00a00cd" path="/var/lib/kubelet/pods/5eeecf4c-4044-477d-8e01-9084d00a00cd/volumes"
Oct 30 21:14:33.259882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.259860    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a9fdb83e-0e08-4749-b33d-6cc1eb189791" path="/var/lib/kubelet/pods/a9fdb83e-0e08-4749-b33d-6cc1eb189791/volumes"
Oct 30 21:14:33.263587 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.263564    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"]
Oct 30 21:14:33.268310 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.268294    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"
Oct 30 21:14:33.281803 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.281774    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"]
Oct 30 21:14:33.301850 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.301820    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-metrics-certs\") pod \"maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.301999 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.301853    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69d74\" (UniqueName: \"kubernetes.io/projected/69ee6c43-664f-4cd4-995c-30312b7ad2e1-kube-api-access-69d74\") pod \"maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.301999 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.301895    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.301999 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.301989    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ee6c43-664f-4cd4-995c-30312b7ad2e1-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.302676 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.302650    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ee6c43-664f-4cd4-995c-30312b7ad2e1-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.304376 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.304346    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-metrics-certs\") pod \"maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.304474 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.304398    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.317087 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.317052    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69d74\" (UniqueName: \"kubernetes.io/projected/69ee6c43-664f-4cd4-995c-30312b7ad2e1-kube-api-access-69d74\") pod \"maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.365519 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.365477    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-single-m-f59b6bcc-dockercfg-dfbjk\""
Oct 30 21:14:33.372911 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.372849    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-49a6a4\""
Oct 30 21:14:33.403401 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.403368    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7nbk\" (UniqueName: \"kubernetes.io/projected/6e08f16f-4d9b-4f42-9dec-a299e0d27572-kube-api-access-c7nbk\") pod \"payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926\" (UID: \"6e08f16f-4d9b-4f42-9dec-a299e0d27572\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"
Oct 30 21:14:33.403575 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.403431    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e08f16f-4d9b-4f42-9dec-a299e0d27572-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926\" (UID: \"6e08f16f-4d9b-4f42-9dec-a299e0d27572\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"
Oct 30 21:14:33.439939 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.439910    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:33.505080 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.505046    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7nbk\" (UniqueName: \"kubernetes.io/projected/6e08f16f-4d9b-4f42-9dec-a299e0d27572-kube-api-access-c7nbk\") pod \"payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926\" (UID: \"6e08f16f-4d9b-4f42-9dec-a299e0d27572\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"
Oct 30 21:14:33.505233 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.505122    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e08f16f-4d9b-4f42-9dec-a299e0d27572-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926\" (UID: \"6e08f16f-4d9b-4f42-9dec-a299e0d27572\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"
Oct 30 21:14:33.505921 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.505892    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e08f16f-4d9b-4f42-9dec-a299e0d27572-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926\" (UID: \"6e08f16f-4d9b-4f42-9dec-a299e0d27572\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"
Oct 30 21:14:33.518039 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.517999    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7nbk\" (UniqueName: \"kubernetes.io/projected/6e08f16f-4d9b-4f42-9dec-a299e0d27572-kube-api-access-c7nbk\") pod \"payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926\" (UID: \"6e08f16f-4d9b-4f42-9dec-a299e0d27572\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"
Oct 30 21:14:33.583938 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.583901    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"
Oct 30 21:14:33.716777 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.716739    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"]
Oct 30 21:14:33.719076 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:14:33.719047    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ee6c43_664f_4cd4_995c_30312b7ad2e1.slice/crio-c3a649f78433e67963151270724c7f6342a9f35623f36e199034d78eefeb6d55 WatchSource:0}: Error finding container c3a649f78433e67963151270724c7f6342a9f35623f36e199034d78eefeb6d55: Status 404 returned error can't find the container with id c3a649f78433e67963151270724c7f6342a9f35623f36e199034d78eefeb6d55
Oct 30 21:14:33.720472 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.720454    6048 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:14:33.862282 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:33.862256    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"]
Oct 30 21:14:33.864786 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:14:33.864758    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e08f16f_4d9b_4f42_9dec_a299e0d27572.slice/crio-3ed9046e46d6b40e6156148f34e3bcb6ef5fb0cf5b33505687ad021296092327 WatchSource:0}: Error finding container 3ed9046e46d6b40e6156148f34e3bcb6ef5fb0cf5b33505687ad021296092327: Status 404 returned error can't find the container with id 3ed9046e46d6b40e6156148f34e3bcb6ef5fb0cf5b33505687ad021296092327
Oct 30 21:14:34.428571 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:34.428478    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926" event={"ID":"6e08f16f-4d9b-4f42-9dec-a299e0d27572","Type":"ContainerStarted","Data":"904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438"}
Oct 30 21:14:34.428571 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:34.428543    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926" event={"ID":"6e08f16f-4d9b-4f42-9dec-a299e0d27572","Type":"ContainerStarted","Data":"3ed9046e46d6b40e6156148f34e3bcb6ef5fb0cf5b33505687ad021296092327"}
Oct 30 21:14:34.429005 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:34.428573    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"
Oct 30 21:14:34.429999 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:34.429974    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp" event={"ID":"69ee6c43-664f-4cd4-995c-30312b7ad2e1","Type":"ContainerStarted","Data":"624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc"}
Oct 30 21:14:34.430128 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:34.430013    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp" event={"ID":"69ee6c43-664f-4cd4-995c-30312b7ad2e1","Type":"ContainerStarted","Data":"c3a649f78433e67963151270724c7f6342a9f35623f36e199034d78eefeb6d55"}
Oct 30 21:14:34.430128 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:34.430077    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:34.448321 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:34.448275    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926" podStartSLOduration=1.448263144 podStartE2EDuration="1.448263144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:34.447439688 +0000 UTC m=+2085.306175981" watchObservedRunningTime="2026-10-30 21:14:34.448263144 +0000 UTC m=+2085.306999437"
Oct 30 21:14:34.472221 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:34.472177    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp" podStartSLOduration=1.042207156 podStartE2EDuration="1.472165488s" totalImagesPullingTime="429.958332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:34.471228872 +0000 UTC m=+2085.329965166" watchObservedRunningTime="2026-10-30 21:14:34.472165488 +0000 UTC m=+2085.330901780"
Oct 30 21:14:40.443797 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:40.443765    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:14:45.441795 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:45.441759    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"
Oct 30 21:14:46.802088 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:14:46.802046    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:14:51.083719 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:51.083684    6048 scope.go:122] "RemoveContainer" containerID="d0d43e10babee4bd464627290718b08726a4e2f73a7d0931d514e6661dd8a20e"
Oct 30 21:14:51.094248 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:51.094224    6048 scope.go:122] "RemoveContainer" containerID="e57a5de17e96e0dd253c57059cf83eee2531eff7397928da6a7d9fdf348fbde6"
Oct 30 21:14:56.001192 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.001146    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"]
Oct 30 21:14:56.007033 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.006993    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.016700 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.016668    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 21:14:56.019201 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.019178    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"]
Oct 30 21:14:56.095834 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.095800    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6qg5v\""
Oct 30 21:14:56.117292 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.117264    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.117391 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.117306    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gtcr\" (UniqueName: \"kubernetes.io/projected/3a24703d-d12a-4443-b40f-7f00a4995d10-kube-api-access-9gtcr\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.117391 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.117335    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.117468 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.117424    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.117503 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.117470    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.117503 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.117491    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a24703d-d12a-4443-b40f-7f00a4995d10-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.117570 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.117526    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a24703d-d12a-4443-b40f-7f00a4995d10-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.117606 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.117588    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.117639 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.117618    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a24703d-d12a-4443-b40f-7f00a4995d10-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.218818 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.218777    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a24703d-d12a-4443-b40f-7f00a4995d10-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.218992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.218856    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.218992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.218878    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gtcr\" (UniqueName: \"kubernetes.io/projected/3a24703d-d12a-4443-b40f-7f00a4995d10-kube-api-access-9gtcr\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.218992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.218895    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.218992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.218912    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.218992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.218932    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.218992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.218949    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a24703d-d12a-4443-b40f-7f00a4995d10-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.219358 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.219102    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a24703d-d12a-4443-b40f-7f00a4995d10-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.219358 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.219158    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.219358 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.219348    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.219811 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.219780    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.219811 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.219799    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.219992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.219855    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a24703d-d12a-4443-b40f-7f00a4995d10-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.219992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.219899    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.221517 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.221491    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a24703d-d12a-4443-b40f-7f00a4995d10-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.221612 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.221601    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a24703d-d12a-4443-b40f-7f00a4995d10-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.231953 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.231928    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a24703d-d12a-4443-b40f-7f00a4995d10-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.232127 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.232110    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gtcr\" (UniqueName: \"kubernetes.io/projected/3a24703d-d12a-4443-b40f-7f00a4995d10-kube-api-access-9gtcr\") pod \"maas-default-gateway-openshift-default-58c6585447-77xqh\" (UID: \"3a24703d-d12a-4443-b40f-7f00a4995d10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.323374 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.323347    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:56.605270 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.605230    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"]
Oct 30 21:14:56.607726 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:14:56.607697    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a24703d_d12a_4443_b40f_7f00a4995d10.slice/crio-3c651a19b413a34a07a5eb2456a12230bbcfeb4b95674cf415a6d37a8aef30f3 WatchSource:0}: Error finding container 3c651a19b413a34a07a5eb2456a12230bbcfeb4b95674cf415a6d37a8aef30f3: Status 404 returned error can't find the container with id 3c651a19b413a34a07a5eb2456a12230bbcfeb4b95674cf415a6d37a8aef30f3
Oct 30 21:14:56.610139 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.610107    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:14:56.610259 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.610183    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:14:56.610259 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:56.610229    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:14:57.570930 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:57.570890    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh" event={"ID":"3a24703d-d12a-4443-b40f-7f00a4995d10","Type":"ContainerStarted","Data":"d4a7f6d2a68c33b063e74bd817976f4afb6b9824951702d17bc261b0d19c36be"}
Oct 30 21:14:57.571422 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:57.570952    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh" event={"ID":"3a24703d-d12a-4443-b40f-7f00a4995d10","Type":"ContainerStarted","Data":"3c651a19b413a34a07a5eb2456a12230bbcfeb4b95674cf415a6d37a8aef30f3"}
Oct 30 21:14:57.595112 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:57.595068    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh" podStartSLOduration=2.595049982 podStartE2EDuration="2.595049982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:57.594619261 +0000 UTC m=+2108.453355555" watchObservedRunningTime="2026-10-30 21:14:57.595049982 +0000 UTC m=+2108.453786276"
Oct 30 21:14:58.323577 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:58.323524    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:14:58.325052 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:58.324991    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-77xqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:14:58.325195 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:58.325069    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh" podUID="3a24703d-d12a-4443-b40f-7f00a4995d10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 21:14:59.324560 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:59.324521    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-77xqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:14:59.324977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:14:59.324577    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh" podUID="3a24703d-d12a-4443-b40f-7f00a4995d10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 21:15:00.324238 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:00.324199    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-77xqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:15:00.324419 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:00.324256    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh" podUID="3a24703d-d12a-4443-b40f-7f00a4995d10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 21:15:01.324732 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:01.324693    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-77xqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:15:01.325134 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:01.324751    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh" podUID="3a24703d-d12a-4443-b40f-7f00a4995d10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 21:15:02.324173 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:02.324137    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-77xqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:15:02.324354 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:02.324203    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh" podUID="3a24703d-d12a-4443-b40f-7f00a4995d10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 21:15:03.324323 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:03.324285    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-77xqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused" start-of-body=
Oct 30 21:15:03.324831 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:03.324339    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh" podUID="3a24703d-d12a-4443-b40f-7f00a4995d10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.119:15021/healthz/ready\": dial tcp 10.134.0.119:15021: connect: connection refused"
Oct 30 21:15:04.859861 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:04.859820    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:15:04.860318 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:04.860293    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:15:04.861139 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:04.861116    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-77xqh"
Oct 30 21:15:16.800972 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:15:16.800932    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:15:39.964871 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:39.964834    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"]
Oct 30 21:15:40.236416 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.236322    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"]
Oct 30 21:15:40.236625 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.236599    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp" podUID="69ee6c43-664f-4cd4-995c-30312b7ad2e1" containerName="maas-api" containerID="cri-o://624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc" gracePeriod=30
Oct 30 21:15:40.438938 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.438889    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp" podUID="69ee6c43-664f-4cd4-995c-30312b7ad2e1" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.117:8443/health\": dial tcp 10.134.0.117:8443: connect: connection refused"
Oct 30 21:15:40.699729 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.699699    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:15:40.779482 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.779393    6048 generic.go:356] "Generic (PLEG): container finished" podID="69ee6c43-664f-4cd4-995c-30312b7ad2e1" containerID="624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc" exitCode=0
Oct 30 21:15:40.779482 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.779446    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"
Oct 30 21:15:40.779725 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.779492    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp" event={"ID":"69ee6c43-664f-4cd4-995c-30312b7ad2e1","Type":"ContainerDied","Data":"624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc"}
Oct 30 21:15:40.779725 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.779556    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp" event={"ID":"69ee6c43-664f-4cd4-995c-30312b7ad2e1","Type":"ContainerDied","Data":"c3a649f78433e67963151270724c7f6342a9f35623f36e199034d78eefeb6d55"}
Oct 30 21:15:40.779725 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.779588    6048 scope.go:122] "RemoveContainer" containerID="624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc"
Oct 30 21:15:40.788119 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.788104    6048 scope.go:122] "RemoveContainer" containerID="624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc"
Oct 30 21:15:40.788397 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:15:40.788378    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc\": container with ID starting with 624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc not found: ID does not exist" containerID="624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc"
Oct 30 21:15:40.788449 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.788406    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc"} err="failed to get container status \"624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc\": rpc error: code = NotFound desc = could not find container \"624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc\": container with ID starting with 624ca32b8bfc9b4de8428e7f02b5627607baa2300254cb898f47987b7569a1cc not found: ID does not exist"
Oct 30 21:15:40.789614 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.789599    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-maas-api-tls\") pod \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") "
Oct 30 21:15:40.789723 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.789712    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-metrics-certs\") pod \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") "
Oct 30 21:15:40.789803 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.789792    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/69ee6c43-664f-4cd4-995c-30312b7ad2e1-kube-api-access-69d74\" (UniqueName: \"kubernetes.io/projected/69ee6c43-664f-4cd4-995c-30312b7ad2e1-kube-api-access-69d74\") pod \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") "
Oct 30 21:15:40.789871 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.789816    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69ee6c43-664f-4cd4-995c-30312b7ad2e1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ee6c43-664f-4cd4-995c-30312b7ad2e1-openshift-service-ca\") pod \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\" (UID: \"69ee6c43-664f-4cd4-995c-30312b7ad2e1\") "
Oct 30 21:15:40.790243 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.790219    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69ee6c43-664f-4cd4-995c-30312b7ad2e1-openshift-service-ca" pod "69ee6c43-664f-4cd4-995c-30312b7ad2e1" (UID: "69ee6c43-664f-4cd4-995c-30312b7ad2e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:40.791849 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.791818    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-metrics-certs" pod "69ee6c43-664f-4cd4-995c-30312b7ad2e1" (UID: "69ee6c43-664f-4cd4-995c-30312b7ad2e1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:15:40.791951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.791830    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69ee6c43-664f-4cd4-995c-30312b7ad2e1-kube-api-access-69d74" pod "69ee6c43-664f-4cd4-995c-30312b7ad2e1" (UID: "69ee6c43-664f-4cd4-995c-30312b7ad2e1"). InnerVolumeSpecName "kube-api-access-69d74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:40.791951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.791848    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-maas-api-tls" pod "69ee6c43-664f-4cd4-995c-30312b7ad2e1" (UID: "69ee6c43-664f-4cd4-995c-30312b7ad2e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:15:40.891379 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.891348    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69d74\" (UniqueName: \"kubernetes.io/projected/69ee6c43-664f-4cd4-995c-30312b7ad2e1-kube-api-access-69d74\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:40.891379 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.891376    6048 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ee6c43-664f-4cd4-995c-30312b7ad2e1-openshift-service-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:40.891555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.891386    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-maas-api-tls\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:40.891555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:40.891402    6048 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69ee6c43-664f-4cd4-995c-30312b7ad2e1-metrics-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:41.102105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:41.102073    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"]
Oct 30 21:15:41.107090 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:41.107064    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-49a6a4-66767b8467-vjsgp"]
Oct 30 21:15:41.258653 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:41.258615    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="69ee6c43-664f-4cd4-995c-30312b7ad2e1" path="/var/lib/kubelet/pods/69ee6c43-664f-4cd4-995c-30312b7ad2e1/volumes"
Oct 30 21:15:44.965174 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:44.965105    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926" podUID="6e08f16f-4d9b-4f42-9dec-a299e0d27572" containerName="payload-processing" containerID="cri-o://904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438" gracePeriod=25
Oct 30 21:15:45.439731 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:45.439693    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926" podUID="6e08f16f-4d9b-4f42-9dec-a299e0d27572" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:15:46.804589 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:15:46.804548    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:15:48.623672 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.623637    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"]
Oct 30 21:15:48.627463 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.627432    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-pbtj8"]
Oct 30 21:15:48.662409 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.662377    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"]
Oct 30 21:15:48.662812 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.662799    6048 cpu_manager.go:414] "containerMap: removing container" podUID="69ee6c43-664f-4cd4-995c-30312b7ad2e1" containerName="maas-api"
Oct 30 21:15:48.662878 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.662812    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69ee6c43-664f-4cd4-995c-30312b7ad2e1" containerName="maas-api"
Oct 30 21:15:48.662935 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.662891    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="69ee6c43-664f-4cd4-995c-30312b7ad2e1" containerName="maas-api"
Oct 30 21:15:48.666045 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.666008    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:48.669931 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.669897    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:15:48.670083 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.669982    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:15:48.671055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.671010    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:15:48.677762 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.677735    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"]
Oct 30 21:15:48.767204 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.767166    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-9pkk7\" (UID: \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:48.767367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.767212    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-9pkk7\" (UID: \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:48.767367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.767311    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr57s\" (UniqueName: \"kubernetes.io/projected/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-kube-api-access-kr57s\") pod \"maas-api-revoke-sub-3d4156f1-9pkk7\" (UID: \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:48.770429 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.770411    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:15:48.868781 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.868748    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-9pkk7\" (UID: \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:48.868975 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.868797    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-9pkk7\" (UID: \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:48.868975 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.868839    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr57s\" (UniqueName: \"kubernetes.io/projected/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-kube-api-access-kr57s\") pod \"maas-api-revoke-sub-3d4156f1-9pkk7\" (UID: \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:48.869489 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.869467    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-9pkk7\" (UID: \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:48.871067 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.871047    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-9pkk7\" (UID: \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:48.881878 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.881828    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr57s\" (UniqueName: \"kubernetes.io/projected/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-kube-api-access-kr57s\") pod \"maas-api-revoke-sub-3d4156f1-9pkk7\" (UID: \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:48.980728 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:48.980700    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:49.256571 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:15:49.256535    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f2d901_fed1_4ec4_8762_cc21d4f2cf03.slice/crio-adad6534261107cb998ea12ab68ad8231866e74f165d73f00fbd0586c3e0064c WatchSource:0}: Error finding container adad6534261107cb998ea12ab68ad8231866e74f165d73f00fbd0586c3e0064c: Status 404 returned error can't find the container with id adad6534261107cb998ea12ab68ad8231866e74f165d73f00fbd0586c3e0064c
Oct 30 21:15:49.259302 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:49.259262    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ec4bd43-c724-49fe-925b-7629fc2d9a53" path="/var/lib/kubelet/pods/1ec4bd43-c724-49fe-925b-7629fc2d9a53/volumes"
Oct 30 21:15:49.259550 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:49.259536    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"]
Oct 30 21:15:49.826091 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:49.826056    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7" event={"ID":"72f2d901-fed1-4ec4-8762-cc21d4f2cf03","Type":"ContainerStarted","Data":"d2589beefbe25fc7987413b4f95b8921a4efb343e7c7e092838545ec54a3d36f"}
Oct 30 21:15:49.826574 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:49.826119    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7" event={"ID":"72f2d901-fed1-4ec4-8762-cc21d4f2cf03","Type":"ContainerStarted","Data":"adad6534261107cb998ea12ab68ad8231866e74f165d73f00fbd0586c3e0064c"}
Oct 30 21:15:49.844239 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:49.844011    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7" podStartSLOduration=1.8439847569999999 podStartE2EDuration="1.843984757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:15:49.843689226 +0000 UTC m=+2160.702425519" watchObservedRunningTime="2026-10-30 21:15:49.843984757 +0000 UTC m=+2160.702721052"
Oct 30 21:15:50.832602 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:50.832568    6048 generic.go:356] "Generic (PLEG): container finished" podID="72f2d901-fed1-4ec4-8762-cc21d4f2cf03" containerID="d2589beefbe25fc7987413b4f95b8921a4efb343e7c7e092838545ec54a3d36f" exitCode=0
Oct 30 21:15:50.832978 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:50.832659    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7" event={"ID":"72f2d901-fed1-4ec4-8762-cc21d4f2cf03","Type":"ContainerDied","Data":"d2589beefbe25fc7987413b4f95b8921a4efb343e7c7e092838545ec54a3d36f"}
Oct 30 21:15:51.971064 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:51.971017    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:52.099936 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:52.099844    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-xks-ca\") pod \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\" (UID: \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\") "
Oct 30 21:15:52.100126 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:52.100044    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-kube-api-access-kr57s\" (UniqueName: \"kubernetes.io/projected/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-kube-api-access-kr57s\") pod \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\" (UID: \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\") "
Oct 30 21:15:52.100126 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:52.100098    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-openshift-ca\") pod \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\" (UID: \"72f2d901-fed1-4ec4-8762-cc21d4f2cf03\") "
Oct 30 21:15:52.100469 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:52.100441    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-openshift-ca" pod "72f2d901-fed1-4ec4-8762-cc21d4f2cf03" (UID: "72f2d901-fed1-4ec4-8762-cc21d4f2cf03"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:15:52.101905 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:52.101879    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-xks-ca" pod "72f2d901-fed1-4ec4-8762-cc21d4f2cf03" (UID: "72f2d901-fed1-4ec4-8762-cc21d4f2cf03"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:15:52.102001 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:52.101969    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-kube-api-access-kr57s" pod "72f2d901-fed1-4ec4-8762-cc21d4f2cf03" (UID: "72f2d901-fed1-4ec4-8762-cc21d4f2cf03"). InnerVolumeSpecName "kube-api-access-kr57s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:15:52.201246 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:52.201206    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr57s\" (UniqueName: \"kubernetes.io/projected/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-kube-api-access-kr57s\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:52.201246 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:52.201238    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:52.201430 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:52.201252    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/72f2d901-fed1-4ec4-8762-cc21d4f2cf03-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:15:52.842512 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:52.842468    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7" event={"ID":"72f2d901-fed1-4ec4-8762-cc21d4f2cf03","Type":"ContainerDied","Data":"adad6534261107cb998ea12ab68ad8231866e74f165d73f00fbd0586c3e0064c"}
Oct 30 21:15:52.842684 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:52.842529    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="adad6534261107cb998ea12ab68ad8231866e74f165d73f00fbd0586c3e0064c"
Oct 30 21:15:52.842684 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:52.842486    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"
Oct 30 21:15:52.892660 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:15:52.892619    6048 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f2d901_fed1_4ec4_8762_cc21d4f2cf03.slice/crio-adad6534261107cb998ea12ab68ad8231866e74f165d73f00fbd0586c3e0064c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f2d901_fed1_4ec4_8762_cc21d4f2cf03.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 21:15:55.440499 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:15:55.440453    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926" podUID="6e08f16f-4d9b-4f42-9dec-a299e0d27572" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 21:16:05.221920 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.221855    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"
Oct 30 21:16:05.325199 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.325162    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6e08f16f-4d9b-4f42-9dec-a299e0d27572-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e08f16f-4d9b-4f42-9dec-a299e0d27572-plugins-config-volume\") pod \"6e08f16f-4d9b-4f42-9dec-a299e0d27572\" (UID: \"6e08f16f-4d9b-4f42-9dec-a299e0d27572\") "
Oct 30 21:16:05.325199 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.325206    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e08f16f-4d9b-4f42-9dec-a299e0d27572-kube-api-access-c7nbk\" (UniqueName: \"kubernetes.io/projected/6e08f16f-4d9b-4f42-9dec-a299e0d27572-kube-api-access-c7nbk\") pod \"6e08f16f-4d9b-4f42-9dec-a299e0d27572\" (UID: \"6e08f16f-4d9b-4f42-9dec-a299e0d27572\") "
Oct 30 21:16:05.325577 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.325549    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e08f16f-4d9b-4f42-9dec-a299e0d27572-plugins-config-volume" pod "6e08f16f-4d9b-4f42-9dec-a299e0d27572" (UID: "6e08f16f-4d9b-4f42-9dec-a299e0d27572"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:16:05.327598 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.327567    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e08f16f-4d9b-4f42-9dec-a299e0d27572-kube-api-access-c7nbk" pod "6e08f16f-4d9b-4f42-9dec-a299e0d27572" (UID: "6e08f16f-4d9b-4f42-9dec-a299e0d27572"). InnerVolumeSpecName "kube-api-access-c7nbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:16:05.426887 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.426857    6048 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e08f16f-4d9b-4f42-9dec-a299e0d27572-plugins-config-volume\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:16:05.426887 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.426883    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7nbk\" (UniqueName: \"kubernetes.io/projected/6e08f16f-4d9b-4f42-9dec-a299e0d27572-kube-api-access-c7nbk\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:16:05.910205 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.910160    6048 generic.go:356] "Generic (PLEG): container finished" podID="6e08f16f-4d9b-4f42-9dec-a299e0d27572" containerID="904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438" exitCode=0
Oct 30 21:16:05.910395 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.910214    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"
Oct 30 21:16:05.910395 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.910250    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926" event={"ID":"6e08f16f-4d9b-4f42-9dec-a299e0d27572","Type":"ContainerDied","Data":"904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438"}
Oct 30 21:16:05.910395 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.910304    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926" event={"ID":"6e08f16f-4d9b-4f42-9dec-a299e0d27572","Type":"ContainerDied","Data":"3ed9046e46d6b40e6156148f34e3bcb6ef5fb0cf5b33505687ad021296092327"}
Oct 30 21:16:05.910395 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.910332    6048 scope.go:122] "RemoveContainer" containerID="904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438"
Oct 30 21:16:05.919395 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.919372    6048 scope.go:122] "RemoveContainer" containerID="904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438"
Oct 30 21:16:05.919692 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:16:05.919665    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438\": container with ID starting with 904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438 not found: ID does not exist" containerID="904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438"
Oct 30 21:16:05.919781 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.919701    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438"} err="failed to get container status \"904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438\": rpc error: code = NotFound desc = could not find container \"904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438\": container with ID starting with 904e78de62f433cd068893414039875ce404284902a4c967ce3aef9ebdb9f438 not found: ID does not exist"
Oct 30 21:16:05.933963 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.933926    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"]
Oct 30 21:16:05.941759 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:05.941733    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-49a6a4-7584bd8b6z2926"]
Oct 30 21:16:07.257490 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:07.257458    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e08f16f-4d9b-4f42-9dec-a299e0d27572" path="/var/lib/kubelet/pods/6e08f16f-4d9b-4f42-9dec-a299e0d27572/volumes"
Oct 30 21:16:16.800230 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:16:16.800192    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:16:26.118350 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.118313    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"]
Oct 30 21:16:26.118737 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.118708    6048 cpu_manager.go:414] "containerMap: removing container" podUID="6e08f16f-4d9b-4f42-9dec-a299e0d27572" containerName="payload-processing"
Oct 30 21:16:26.118737 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.118720    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e08f16f-4d9b-4f42-9dec-a299e0d27572" containerName="payload-processing"
Oct 30 21:16:26.118813 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.118759    6048 cpu_manager.go:414] "containerMap: removing container" podUID="72f2d901-fed1-4ec4-8762-cc21d4f2cf03" containerName="revoke-keys"
Oct 30 21:16:26.118813 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.118764    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72f2d901-fed1-4ec4-8762-cc21d4f2cf03" containerName="revoke-keys"
Oct 30 21:16:26.118876 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.118832    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e08f16f-4d9b-4f42-9dec-a299e0d27572" containerName="payload-processing"
Oct 30 21:16:26.118876 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.118848    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="72f2d901-fed1-4ec4-8762-cc21d4f2cf03" containerName="revoke-keys"
Oct 30 21:16:26.121990 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.121973    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.138010 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.137985    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"]
Oct 30 21:16:26.150361 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.150332    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"]
Oct 30 21:16:26.153989 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.153967    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.171859 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.171823    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"]
Oct 30 21:16:26.223370 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.223335    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.223370 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.223380    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.223603 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.223477    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/794efeb8-0f81-4915-bbbd-80699907b7f9-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.223603 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.223530    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.223706 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.223618    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76xl7\" (UniqueName: \"kubernetes.io/projected/794efeb8-0f81-4915-bbbd-80699907b7f9-kube-api-access-76xl7\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.223766 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.223713    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wgnk\" (UniqueName: \"kubernetes.io/projected/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-kube-api-access-6wgnk\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.223830 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.223800    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/794efeb8-0f81-4915-bbbd-80699907b7f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.223884 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.223839    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.223940 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.223900    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.223940 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.223929    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/794efeb8-0f81-4915-bbbd-80699907b7f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.224085 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.223960    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.224085 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.224003    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.224085 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.224042    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.224240 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.224092    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.224240 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.224143    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.224240 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.224175    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.224240 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.224208    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.224454 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.224270    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.325639 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.325603    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.325639 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.325641    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.325880 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.325681    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.325880 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.325717    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.325880 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.325744    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.325880 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.325773    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.325880 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.325819    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.325880 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.325855    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.326254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.325888    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.326254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.325921    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/794efeb8-0f81-4915-bbbd-80699907b7f9-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.326254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.325948    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.326254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.325979    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76xl7\" (UniqueName: \"kubernetes.io/projected/794efeb8-0f81-4915-bbbd-80699907b7f9-kube-api-access-76xl7\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.326254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.326017    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wgnk\" (UniqueName: \"kubernetes.io/projected/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-kube-api-access-6wgnk\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.326254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.326080    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/794efeb8-0f81-4915-bbbd-80699907b7f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.326254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.326087    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.326254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.326132    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.326254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.326192    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.326254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.326220    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/794efeb8-0f81-4915-bbbd-80699907b7f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.326254 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.326249    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.326877 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.326270    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.326877 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.326552    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-workload-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.326877 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.326722    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.326877 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.326836    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-workload-certs\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.327126 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.326933    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.327126 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.327115    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.327243 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.327146    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-credential-socket\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.327390 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.327368    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-istio-data\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.327457 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.327392    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/794efeb8-0f81-4915-bbbd-80699907b7f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.328563 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.328537    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.328686 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.328542    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/794efeb8-0f81-4915-bbbd-80699907b7f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.328949 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.328928    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/794efeb8-0f81-4915-bbbd-80699907b7f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.329047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.328979    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istio-envoy\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.338041 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.337990    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.338364 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.338343    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wgnk\" (UniqueName: \"kubernetes.io/projected/ad4e2a15-d67f-4ea2-b876-b9dc237497a3-kube-api-access-6wgnk\") pod \"maas-default-gateway-openshift-default-58c6585447-q29bh\" (UID: \"ad4e2a15-d67f-4ea2-b876-b9dc237497a3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.338647 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.338631    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76xl7\" (UniqueName: \"kubernetes.io/projected/794efeb8-0f81-4915-bbbd-80699907b7f9-kube-api-access-76xl7\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.338749 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.338733    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/794efeb8-0f81-4915-bbbd-80699907b7f9-istio-token\") pod \"maas-default-gateway-openshift-default-58c6585447-gddkd\" (UID: \"794efeb8-0f81-4915-bbbd-80699907b7f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.435280 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.435203    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:26.470330 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.470291    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:26.715714 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.715639    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"]
Oct 30 21:16:26.719856 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:16:26.719829    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4e2a15_d67f_4ea2_b876_b9dc237497a3.slice/crio-e0f2bbf09ab7e023e5ffaf5119eed6aef965eafb575a7950f66f6e7c2db8975c WatchSource:0}: Error finding container e0f2bbf09ab7e023e5ffaf5119eed6aef965eafb575a7950f66f6e7c2db8975c: Status 404 returned error can't find the container with id e0f2bbf09ab7e023e5ffaf5119eed6aef965eafb575a7950f66f6e7c2db8975c
Oct 30 21:16:26.722048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.722003    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:16:26.722129 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.722084    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:16:26.722172 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.722133    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:16:26.759076 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.759055    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"]
Oct 30 21:16:26.761209 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:16:26.761179    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794efeb8_0f81_4915_bbbd_80699907b7f9.slice/crio-c52eae63c9c29ed0514886a8de0062af1790cf3d90ac21463b90e36742483a9e WatchSource:0}: Error finding container c52eae63c9c29ed0514886a8de0062af1790cf3d90ac21463b90e36742483a9e: Status 404 returned error can't find the container with id c52eae63c9c29ed0514886a8de0062af1790cf3d90ac21463b90e36742483a9e
Oct 30 21:16:26.763524 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.763494    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:16:26.763623 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.763567    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:16:26.763623 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:26.763612    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:16:27.014502 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:27.014393    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" event={"ID":"ad4e2a15-d67f-4ea2-b876-b9dc237497a3","Type":"ContainerStarted","Data":"ccdae3811f8090dbd27731205ba063aa012d7b4a208079ffd4ce305c65a9bb2f"}
Oct 30 21:16:27.014502 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:27.014462    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" event={"ID":"ad4e2a15-d67f-4ea2-b876-b9dc237497a3","Type":"ContainerStarted","Data":"e0f2bbf09ab7e023e5ffaf5119eed6aef965eafb575a7950f66f6e7c2db8975c"}
Oct 30 21:16:27.016221 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:27.016187    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" event={"ID":"794efeb8-0f81-4915-bbbd-80699907b7f9","Type":"ContainerStarted","Data":"b7ecc0cdc30e46739083dcbc5198424781717b06b6591d0f180f34cd7c3b32e1"}
Oct 30 21:16:27.016429 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:27.016235    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" event={"ID":"794efeb8-0f81-4915-bbbd-80699907b7f9","Type":"ContainerStarted","Data":"c52eae63c9c29ed0514886a8de0062af1790cf3d90ac21463b90e36742483a9e"}
Oct 30 21:16:27.039049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:27.038962    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" podStartSLOduration=1.038947691 podStartE2EDuration="1.038947691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:27.037275597 +0000 UTC m=+2197.896011891" watchObservedRunningTime="2026-10-30 21:16:27.038947691 +0000 UTC m=+2197.897683978"
Oct 30 21:16:27.060559 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:27.060495    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" podStartSLOduration=1.06047495 podStartE2EDuration="1.06047495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:27.05931197 +0000 UTC m=+2197.918048264" watchObservedRunningTime="2026-10-30 21:16:27.06047495 +0000 UTC m=+2197.919211243"
Oct 30 21:16:27.436422 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:27.436389    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:27.437747 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:27.437720    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q29bh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused" start-of-body=
Oct 30 21:16:27.437893 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:27.437776    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" podUID="ad4e2a15-d67f-4ea2-b876-b9dc237497a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused"
Oct 30 21:16:27.471445 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:27.471413    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:27.472551 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:27.472511    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gddkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:16:27.472665 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:27.472575    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" podUID="794efeb8-0f81-4915-bbbd-80699907b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 21:16:28.440082 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:28.440052    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:28.474594 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:28.474562    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:29.035122 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:29.035089    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:29.035384 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:29.035359    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:29.035878 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:29.035861    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:16:29.036114 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:16:29.036085    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:16:46.801669 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:16:46.801622    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:17:16.799963 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:17:16.799919    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:17:46.804049 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:17:46.803941    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:18:00.076230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:00.076180    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q29bh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:18:00.076230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:00.076180    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gddkd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:18:00.076836 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:00.076264    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" podUID="794efeb8-0f81-4915-bbbd-80699907b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:18:00.076836 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:00.076249    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" podUID="ad4e2a15-d67f-4ea2-b876-b9dc237497a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:18:01.127039 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.126971    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"]
Oct 30 21:18:01.152405 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.152365    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"]
Oct 30 21:18:01.152610 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.152438    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:01.157239 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.157168    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:18:01.161269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.161242    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:18:01.161400 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.161305    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:18:01.161400 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.161366    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:18:01.231372 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.231332    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-vmjh5\" (UID: \"19e8b589-40bc-439a-80c5-911238a83b42\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:01.231562 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.231386    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjqbl\" (UniqueName: \"kubernetes.io/projected/19e8b589-40bc-439a-80c5-911238a83b42-kube-api-access-qjqbl\") pod \"maas-api-revoke-sub-d576e68b-vmjh5\" (UID: \"19e8b589-40bc-439a-80c5-911238a83b42\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:01.231562 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.231501    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-vmjh5\" (UID: \"19e8b589-40bc-439a-80c5-911238a83b42\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:01.332205 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.332168    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-vmjh5\" (UID: \"19e8b589-40bc-439a-80c5-911238a83b42\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:01.332386 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.332236    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-vmjh5\" (UID: \"19e8b589-40bc-439a-80c5-911238a83b42\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:01.332386 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.332269    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjqbl\" (UniqueName: \"kubernetes.io/projected/19e8b589-40bc-439a-80c5-911238a83b42-kube-api-access-qjqbl\") pod \"maas-api-revoke-sub-d576e68b-vmjh5\" (UID: \"19e8b589-40bc-439a-80c5-911238a83b42\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:01.333142 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.333115    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d576e68b-vmjh5\" (UID: \"19e8b589-40bc-439a-80c5-911238a83b42\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:01.334638 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.334613    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d576e68b-vmjh5\" (UID: \"19e8b589-40bc-439a-80c5-911238a83b42\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:01.345218 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.345193    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjqbl\" (UniqueName: \"kubernetes.io/projected/19e8b589-40bc-439a-80c5-911238a83b42-kube-api-access-qjqbl\") pod \"maas-api-revoke-sub-d576e68b-vmjh5\" (UID: \"19e8b589-40bc-439a-80c5-911238a83b42\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:01.490811 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.490726    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:01.776167 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:01.776143    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"]
Oct 30 21:18:01.819000 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:18:01.818966    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e8b589_40bc_439a_80c5_911238a83b42.slice/crio-a23ca2f3ee8aaf97329f66b6c502a3596f64edf0c888fe16d756c1a5ea1b85e5 WatchSource:0}: Error finding container a23ca2f3ee8aaf97329f66b6c502a3596f64edf0c888fe16d756c1a5ea1b85e5: Status 404 returned error can't find the container with id a23ca2f3ee8aaf97329f66b6c502a3596f64edf0c888fe16d756c1a5ea1b85e5
Oct 30 21:18:02.476516 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.476481    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5" event={"ID":"19e8b589-40bc-439a-80c5-911238a83b42","Type":"ContainerStarted","Data":"2cf3019982c90c5b09acd24827d04eab168ad23a46876f77e3c2d4e6623f5158"}
Oct 30 21:18:02.476933 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.476538    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5" event={"ID":"19e8b589-40bc-439a-80c5-911238a83b42","Type":"ContainerStarted","Data":"a23ca2f3ee8aaf97329f66b6c502a3596f64edf0c888fe16d756c1a5ea1b85e5"}
Oct 30 21:18:02.477995 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.477968    6048 generic.go:356] "Generic (PLEG): container finished" podID="ad4e2a15-d67f-4ea2-b876-b9dc237497a3" containerID="ccdae3811f8090dbd27731205ba063aa012d7b4a208079ffd4ce305c65a9bb2f" exitCode=0
Oct 30 21:18:02.478141 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.478057    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" event={"ID":"ad4e2a15-d67f-4ea2-b876-b9dc237497a3","Type":"ContainerDied","Data":"ccdae3811f8090dbd27731205ba063aa012d7b4a208079ffd4ce305c65a9bb2f"}
Oct 30 21:18:02.478403 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.478386    6048 scope.go:122] "RemoveContainer" containerID="ccdae3811f8090dbd27731205ba063aa012d7b4a208079ffd4ce305c65a9bb2f"
Oct 30 21:18:02.479536 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.479508    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:18:02.479641 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.479571    6048 generic.go:356] "Generic (PLEG): container finished" podID="794efeb8-0f81-4915-bbbd-80699907b7f9" containerID="b7ecc0cdc30e46739083dcbc5198424781717b06b6591d0f180f34cd7c3b32e1" exitCode=0
Oct 30 21:18:02.479641 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.479591    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:18:02.479744 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.479636    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" event={"ID":"794efeb8-0f81-4915-bbbd-80699907b7f9","Type":"ContainerDied","Data":"b7ecc0cdc30e46739083dcbc5198424781717b06b6591d0f180f34cd7c3b32e1"}
Oct 30 21:18:02.479744 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.479642    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:18:02.479931 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.479916    6048 scope.go:122] "RemoveContainer" containerID="b7ecc0cdc30e46739083dcbc5198424781717b06b6591d0f180f34cd7c3b32e1"
Oct 30 21:18:02.480858 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.480834    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:18:02.480908 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.480892    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:18:02.480980 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.480968    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:18:02.498934 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:02.498886    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5" podStartSLOduration=1.498873136 podStartE2EDuration="1.498873136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:02.497154627 +0000 UTC m=+2293.355890922" watchObservedRunningTime="2026-10-30 21:18:02.498873136 +0000 UTC m=+2293.357609429"
Oct 30 21:18:03.498225 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:03.498186    6048 generic.go:356] "Generic (PLEG): container finished" podID="19e8b589-40bc-439a-80c5-911238a83b42" containerID="2cf3019982c90c5b09acd24827d04eab168ad23a46876f77e3c2d4e6623f5158" exitCode=0
Oct 30 21:18:03.498618 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:03.498285    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5" event={"ID":"19e8b589-40bc-439a-80c5-911238a83b42","Type":"ContainerDied","Data":"2cf3019982c90c5b09acd24827d04eab168ad23a46876f77e3c2d4e6623f5158"}
Oct 30 21:18:03.500782 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:03.500562    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" event={"ID":"ad4e2a15-d67f-4ea2-b876-b9dc237497a3","Type":"ContainerStarted","Data":"36fa0f92078ee94fa517421add254f614af3499bc3df41e746fbe2d409f219ed"}
Oct 30 21:18:03.502359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:03.502338    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" event={"ID":"794efeb8-0f81-4915-bbbd-80699907b7f9","Type":"ContainerStarted","Data":"8ae633256dfdcceccc47406c154cf10ed529e3066b880974de9a843f60754931"}
Oct 30 21:18:04.435460 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.435424    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:18:04.435772 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.435748    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q29bh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused" start-of-body=
Oct 30 21:18:04.435821 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.435798    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" podUID="ad4e2a15-d67f-4ea2-b876-b9dc237497a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused"
Oct 30 21:18:04.475046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.474190    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:18:04.475046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.474748    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gddkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:18:04.475046 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.474811    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" podUID="794efeb8-0f81-4915-bbbd-80699907b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 21:18:04.728633 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.728605    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:04.921798 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.921756    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-xks-ca\") pod \"19e8b589-40bc-439a-80c5-911238a83b42\" (UID: \"19e8b589-40bc-439a-80c5-911238a83b42\") "
Oct 30 21:18:04.922004 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.921985    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-openshift-ca\") pod \"19e8b589-40bc-439a-80c5-911238a83b42\" (UID: \"19e8b589-40bc-439a-80c5-911238a83b42\") "
Oct 30 21:18:04.922081 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.922042    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19e8b589-40bc-439a-80c5-911238a83b42-kube-api-access-qjqbl\" (UniqueName: \"kubernetes.io/projected/19e8b589-40bc-439a-80c5-911238a83b42-kube-api-access-qjqbl\") pod \"19e8b589-40bc-439a-80c5-911238a83b42\" (UID: \"19e8b589-40bc-439a-80c5-911238a83b42\") "
Oct 30 21:18:04.922963 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.922925    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-openshift-ca" pod "19e8b589-40bc-439a-80c5-911238a83b42" (UID: "19e8b589-40bc-439a-80c5-911238a83b42"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:04.924362 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.924337    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19e8b589-40bc-439a-80c5-911238a83b42-kube-api-access-qjqbl" pod "19e8b589-40bc-439a-80c5-911238a83b42" (UID: "19e8b589-40bc-439a-80c5-911238a83b42"). InnerVolumeSpecName "kube-api-access-qjqbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:04.924585 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:04.924569    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-xks-ca" pod "19e8b589-40bc-439a-80c5-911238a83b42" (UID: "19e8b589-40bc-439a-80c5-911238a83b42"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:05.022920 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:05.022832    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:18:05.022920 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:05.022867    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjqbl\" (UniqueName: \"kubernetes.io/projected/19e8b589-40bc-439a-80c5-911238a83b42-kube-api-access-qjqbl\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:18:05.022920 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:05.022877    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/19e8b589-40bc-439a-80c5-911238a83b42-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:18:05.436238 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:05.436197    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q29bh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused" start-of-body=
Oct 30 21:18:05.436437 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:05.436257    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" podUID="ad4e2a15-d67f-4ea2-b876-b9dc237497a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused"
Oct 30 21:18:05.479048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:05.478446    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gddkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:18:05.479048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:05.478510    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" podUID="794efeb8-0f81-4915-bbbd-80699907b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 21:18:05.513407 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:05.513385    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"
Oct 30 21:18:05.513661 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:05.513412    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5" event={"ID":"19e8b589-40bc-439a-80c5-911238a83b42","Type":"ContainerDied","Data":"a23ca2f3ee8aaf97329f66b6c502a3596f64edf0c888fe16d756c1a5ea1b85e5"}
Oct 30 21:18:05.513718 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:05.513684    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a23ca2f3ee8aaf97329f66b6c502a3596f64edf0c888fe16d756c1a5ea1b85e5"
Oct 30 21:18:06.436185 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:06.436152    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q29bh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused" start-of-body=
Oct 30 21:18:06.436620 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:06.436206    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" podUID="ad4e2a15-d67f-4ea2-b876-b9dc237497a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused"
Oct 30 21:18:06.474048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:06.473489    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gddkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:18:06.474048 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:06.473564    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" podUID="794efeb8-0f81-4915-bbbd-80699907b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 21:18:07.436069 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:07.436006    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q29bh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused" start-of-body=
Oct 30 21:18:07.436265 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:07.436084    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" podUID="ad4e2a15-d67f-4ea2-b876-b9dc237497a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused"
Oct 30 21:18:07.471472 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:07.471427    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gddkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:18:07.471760 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:07.471729    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" podUID="794efeb8-0f81-4915-bbbd-80699907b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 21:18:08.436394 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:08.436354    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q29bh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused" start-of-body=
Oct 30 21:18:08.436795 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:08.436412    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" podUID="ad4e2a15-d67f-4ea2-b876-b9dc237497a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused"
Oct 30 21:18:08.471394 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:08.471352    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gddkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:18:08.471590 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:08.471415    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" podUID="794efeb8-0f81-4915-bbbd-80699907b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 21:18:09.436132 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:09.436093    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q29bh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused" start-of-body=
Oct 30 21:18:09.436334 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:09.436166    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" podUID="ad4e2a15-d67f-4ea2-b876-b9dc237497a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": dial tcp 10.134.0.121:15021: connect: connection refused"
Oct 30 21:18:09.471374 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:09.471337    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gddkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused" start-of-body=
Oct 30 21:18:09.471751 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:09.471403    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" podUID="794efeb8-0f81-4915-bbbd-80699907b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": dial tcp 10.134.0.122:15021: connect: connection refused"
Oct 30 21:18:10.801825 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:10.801792    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:18:10.802490 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:10.802467    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:18:10.803256 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:10.803232    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd"
Oct 30 21:18:10.811591 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:10.811568    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:18:10.811911 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:10.811893    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:18:10.812686 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:10.812668    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh"
Oct 30 21:18:16.837824 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:18:16.837790    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:18:20.356412 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.356365    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"]
Oct 30 21:18:20.356929 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.356864    6048 cpu_manager.go:414] "containerMap: removing container" podUID="19e8b589-40bc-439a-80c5-911238a83b42" containerName="revoke-keys"
Oct 30 21:18:20.356929 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.356879    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19e8b589-40bc-439a-80c5-911238a83b42" containerName="revoke-keys"
Oct 30 21:18:20.357085 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.356963    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="19e8b589-40bc-439a-80c5-911238a83b42" containerName="revoke-keys"
Oct 30 21:18:20.360262 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.360238    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:20.368143 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.368100    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:18:20.368266 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.368143    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:18:20.368678 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.368636    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:18:20.368678 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.368645    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:18:20.370414 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.370394    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"]
Oct 30 21:18:20.460868 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.460835    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-9dnxz\" (UID: \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:20.461084 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.460909    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-9dnxz\" (UID: \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:20.461173 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.461089    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmw9t\" (UniqueName: \"kubernetes.io/projected/91b4f100-1b89-408f-a19f-56ec3a63ec9f-kube-api-access-dmw9t\") pod \"maas-api-revoke-sub-d2bc93bc-9dnxz\" (UID: \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:20.562078 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.562042    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmw9t\" (UniqueName: \"kubernetes.io/projected/91b4f100-1b89-408f-a19f-56ec3a63ec9f-kube-api-access-dmw9t\") pod \"maas-api-revoke-sub-d2bc93bc-9dnxz\" (UID: \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:20.562277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.562111    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-9dnxz\" (UID: \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:20.562277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.562165    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-9dnxz\" (UID: \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:20.562908 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.562882    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d2bc93bc-9dnxz\" (UID: \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:20.564946 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.564925    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d2bc93bc-9dnxz\" (UID: \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:20.576647 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.576622    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmw9t\" (UniqueName: \"kubernetes.io/projected/91b4f100-1b89-408f-a19f-56ec3a63ec9f-kube-api-access-dmw9t\") pod \"maas-api-revoke-sub-d2bc93bc-9dnxz\" (UID: \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:20.674581 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.674504    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:20.947712 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:20.947688    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"]
Oct 30 21:18:20.950075 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:18:20.950047    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b4f100_1b89_408f_a19f_56ec3a63ec9f.slice/crio-40d3f21e1bd05e80e573492eb07314c059853a19bd0551f3225e38347a6fc7c2 WatchSource:0}: Error finding container 40d3f21e1bd05e80e573492eb07314c059853a19bd0551f3225e38347a6fc7c2: Status 404 returned error can't find the container with id 40d3f21e1bd05e80e573492eb07314c059853a19bd0551f3225e38347a6fc7c2
Oct 30 21:18:21.612445 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:21.612412    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz" event={"ID":"91b4f100-1b89-408f-a19f-56ec3a63ec9f","Type":"ContainerStarted","Data":"10d19647bf2c41be61c709cfea96f1c0e3e202c8f421f468cd5e506e77761b42"}
Oct 30 21:18:21.612923 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:21.612467    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz" event={"ID":"91b4f100-1b89-408f-a19f-56ec3a63ec9f","Type":"ContainerStarted","Data":"40d3f21e1bd05e80e573492eb07314c059853a19bd0551f3225e38347a6fc7c2"}
Oct 30 21:18:21.632922 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:21.632870    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz" podStartSLOduration=1.6328576240000001 podStartE2EDuration="1.632857624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:21.630946485 +0000 UTC m=+2312.489682782" watchObservedRunningTime="2026-10-30 21:18:21.632857624 +0000 UTC m=+2312.491593953"
Oct 30 21:18:22.619498 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:22.619463    6048 generic.go:356] "Generic (PLEG): container finished" podID="91b4f100-1b89-408f-a19f-56ec3a63ec9f" containerID="10d19647bf2c41be61c709cfea96f1c0e3e202c8f421f468cd5e506e77761b42" exitCode=0
Oct 30 21:18:22.619927 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:22.619546    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz" event={"ID":"91b4f100-1b89-408f-a19f-56ec3a63ec9f","Type":"ContainerDied","Data":"10d19647bf2c41be61c709cfea96f1c0e3e202c8f421f468cd5e506e77761b42"}
Oct 30 21:18:23.767897 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:23.767870    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:23.792937 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:23.792904    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-xks-ca\") pod \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\" (UID: \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\") "
Oct 30 21:18:23.793090 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:23.792951    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/91b4f100-1b89-408f-a19f-56ec3a63ec9f-kube-api-access-dmw9t\" (UniqueName: \"kubernetes.io/projected/91b4f100-1b89-408f-a19f-56ec3a63ec9f-kube-api-access-dmw9t\") pod \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\" (UID: \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\") "
Oct 30 21:18:23.793203 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:23.793187    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-openshift-ca\") pod \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\" (UID: \"91b4f100-1b89-408f-a19f-56ec3a63ec9f\") "
Oct 30 21:18:23.793618 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:23.793593    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-openshift-ca" pod "91b4f100-1b89-408f-a19f-56ec3a63ec9f" (UID: "91b4f100-1b89-408f-a19f-56ec3a63ec9f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:23.795279 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:23.795248    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-xks-ca" pod "91b4f100-1b89-408f-a19f-56ec3a63ec9f" (UID: "91b4f100-1b89-408f-a19f-56ec3a63ec9f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:23.795396 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:23.795341    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b4f100-1b89-408f-a19f-56ec3a63ec9f-kube-api-access-dmw9t" pod "91b4f100-1b89-408f-a19f-56ec3a63ec9f" (UID: "91b4f100-1b89-408f-a19f-56ec3a63ec9f"). InnerVolumeSpecName "kube-api-access-dmw9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:23.894150 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:23.894064    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:18:23.894150 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:23.894096    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmw9t\" (UniqueName: \"kubernetes.io/projected/91b4f100-1b89-408f-a19f-56ec3a63ec9f-kube-api-access-dmw9t\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:18:23.894150 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:23.894108    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/91b4f100-1b89-408f-a19f-56ec3a63ec9f-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:18:24.631092 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:24.631066    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"
Oct 30 21:18:24.631279 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:24.631062    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz" event={"ID":"91b4f100-1b89-408f-a19f-56ec3a63ec9f","Type":"ContainerDied","Data":"40d3f21e1bd05e80e573492eb07314c059853a19bd0551f3225e38347a6fc7c2"}
Oct 30 21:18:24.631279 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:24.631184    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40d3f21e1bd05e80e573492eb07314c059853a19bd0551f3225e38347a6fc7c2"
Oct 30 21:18:32.496975 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.496943    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"]
Oct 30 21:18:32.497415 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.497400    6048 cpu_manager.go:414] "containerMap: removing container" podUID="91b4f100-1b89-408f-a19f-56ec3a63ec9f" containerName="revoke-keys"
Oct 30 21:18:32.497464 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.497416    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="91b4f100-1b89-408f-a19f-56ec3a63ec9f" containerName="revoke-keys"
Oct 30 21:18:32.497512 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.497503    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="91b4f100-1b89-408f-a19f-56ec3a63ec9f" containerName="revoke-keys"
Oct 30 21:18:32.500589 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.500574    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.518586 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.518557    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-single-main-11b629-openshift-default-dockercfg-xkxjq\""
Oct 30 21:18:32.520765 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.520743    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"]
Oct 30 21:18:32.579392 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.579353    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-data\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.579555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.579406    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-socket\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.579555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.579484    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istiod-ca-cert\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.579555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.579528    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9xx9\" (UniqueName: \"kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-kube-api-access-p9xx9\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.579654 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.579560    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-envoy\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.579694 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.579660    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-podinfo\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.579731 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.579693    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-certs\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.579731 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.579726    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-credential-socket\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.579822 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.579809    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-token\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.680884 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.680852    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-token\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681095 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.680900    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-data\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681095 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.680935    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-socket\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681095 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.680958    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istiod-ca-cert\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681095 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.680981    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9xx9\" (UniqueName: \"kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-kube-api-access-p9xx9\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681095 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.681045    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-envoy\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681403 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.681112    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-podinfo\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681403 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.681300    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-certs\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681403 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.681369    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-credential-socket\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681560 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.681411    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-data\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681560 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.681448    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-socket\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681667 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.681642    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-certs\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681732 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.681710    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-credential-socket\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.681852 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.681823    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istiod-ca-cert\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.683372 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.683351    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-envoy\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.683589 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.683571    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-podinfo\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.693489 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.693466    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9xx9\" (UniqueName: \"kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-kube-api-access-p9xx9\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.693727 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.693707    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-token\") pod \"e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") " pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:32.813838 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:32.813811    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:33.093928 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:33.093898    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"]
Oct 30 21:18:33.096527 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:18:33.096498    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0970b0_9997_4ab8_ac6f_2d8f602cd209.slice/crio-30d82ec2b40772e69a8fbae93036a2c82c9c355908104ec0c9a61d8101a4ad4c WatchSource:0}: Error finding container 30d82ec2b40772e69a8fbae93036a2c82c9c355908104ec0c9a61d8101a4ad4c: Status 404 returned error can't find the container with id 30d82ec2b40772e69a8fbae93036a2c82c9c355908104ec0c9a61d8101a4ad4c
Oct 30 21:18:33.098566 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:33.098533    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:18:33.098678 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:33.098611    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:18:33.098678 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:33.098658    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:18:33.683205 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:33.683172    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" event={"ID":"cc0970b0-9997-4ab8-ac6f-2d8f602cd209","Type":"ContainerStarted","Data":"1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd"}
Oct 30 21:18:33.683649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:33.683228    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" event={"ID":"cc0970b0-9997-4ab8-ac6f-2d8f602cd209","Type":"ContainerStarted","Data":"30d82ec2b40772e69a8fbae93036a2c82c9c355908104ec0c9a61d8101a4ad4c"}
Oct 30 21:18:33.709906 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:33.709852    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" podStartSLOduration=1.7098387659999998 podStartE2EDuration="1.709838766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:33.707799228 +0000 UTC m=+2324.566535522" watchObservedRunningTime="2026-10-30 21:18:33.709838766 +0000 UTC m=+2324.568575058"
Oct 30 21:18:33.814446 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:33.814419    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:34.819906 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:34.819874    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:35.696062 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:35.696011    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:35.697000 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:35.696984    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:37.149458 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.149418    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"]
Oct 30 21:18:37.153343 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.153316    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.168863 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.168817    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"]
Oct 30 21:18:37.170530 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.170500    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-11b629-serving-cert\""
Oct 30 21:18:37.170926 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.170908    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:18:37.171072 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.170924    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:18:37.171072 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.170952    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 21:18:37.171072 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.170969    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-57jm5\""
Oct 30 21:18:37.230925 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.230884    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-metrics-certs\") pod \"maas-api-e2e-worker-single-main-11b629-6654756d69-958hf\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.231122 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.230946    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztpp5\" (UniqueName: \"kubernetes.io/projected/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-kube-api-access-ztpp5\") pod \"maas-api-e2e-worker-single-main-11b629-6654756d69-958hf\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.231122 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.231060    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-11b629-6654756d69-958hf\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.231122 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.231119    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-11b629-6654756d69-958hf\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.332398 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.332363    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztpp5\" (UniqueName: \"kubernetes.io/projected/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-kube-api-access-ztpp5\") pod \"maas-api-e2e-worker-single-main-11b629-6654756d69-958hf\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.332569 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.332416    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-11b629-6654756d69-958hf\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.332569 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.332463    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-11b629-6654756d69-958hf\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.332569 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.332530    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-metrics-certs\") pod \"maas-api-e2e-worker-single-main-11b629-6654756d69-958hf\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.333221 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.333195    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-11b629-6654756d69-958hf\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.334930 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.334905    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-metrics-certs\") pod \"maas-api-e2e-worker-single-main-11b629-6654756d69-958hf\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.335035 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.334948    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-11b629-6654756d69-958hf\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.355752 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.355725    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztpp5\" (UniqueName: \"kubernetes.io/projected/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-kube-api-access-ztpp5\") pod \"maas-api-e2e-worker-single-main-11b629-6654756d69-958hf\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.472058 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.471941    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:37.748336 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:37.748306    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"]
Oct 30 21:18:37.752184 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:18:37.752153    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3124c9f_4d4c_47d1_bea0_3891d5815ff7.slice/crio-6b4f8aaf2d5f92b2b287bfabce372be1365d516d9bd2a3b659027eb21ee83c82 WatchSource:0}: Error finding container 6b4f8aaf2d5f92b2b287bfabce372be1365d516d9bd2a3b659027eb21ee83c82: Status 404 returned error can't find the container with id 6b4f8aaf2d5f92b2b287bfabce372be1365d516d9bd2a3b659027eb21ee83c82
Oct 30 21:18:38.712880 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:38.712848    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf" event={"ID":"a3124c9f-4d4c-47d1-bea0-3891d5815ff7","Type":"ContainerStarted","Data":"0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8"}
Oct 30 21:18:38.713320 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:38.712900    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf" event={"ID":"a3124c9f-4d4c-47d1-bea0-3891d5815ff7","Type":"ContainerStarted","Data":"6b4f8aaf2d5f92b2b287bfabce372be1365d516d9bd2a3b659027eb21ee83c82"}
Oct 30 21:18:38.713320 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:38.712991    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:38.734514 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:38.734463    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf" podStartSLOduration=1.279799076 podStartE2EDuration="1.734446511s" totalImagesPullingTime="454.647435ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:38.732190492 +0000 UTC m=+2329.590926785" watchObservedRunningTime="2026-10-30 21:18:38.734446511 +0000 UTC m=+2329.593182806"
Oct 30 21:18:44.722478 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:44.722447    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:18:46.807443 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:18:46.807402    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:18:48.799508 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:48.799480    6048 generic.go:356] "Generic (PLEG): container finished" podID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerID="1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd" exitCode=0
Oct 30 21:18:48.799867 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:48.799552    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" event={"ID":"cc0970b0-9997-4ab8-ac6f-2d8f602cd209","Type":"ContainerDied","Data":"1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd"}
Oct 30 21:18:48.799983 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:48.799960    6048 scope.go:122] "RemoveContainer" containerID="1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd"
Oct 30 21:18:48.801223 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:48.801194    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:18:48.801346 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:48.801275    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:18:48.801346 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:48.801324    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:18:49.807323 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:49.807268    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" event={"ID":"cc0970b0-9997-4ab8-ac6f-2d8f602cd209","Type":"ContainerStarted","Data":"cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09"}
Oct 30 21:18:49.814541 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:49.814511    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:49.815607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:49.815583    6048 patch_prober.go:29] interesting pod/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.125:15021/healthz/ready\": dial tcp 10.134.0.125:15021: connect: connection refused" start-of-body=
Oct 30 21:18:49.815727 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:49.815628    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.125:15021/healthz/ready\": dial tcp 10.134.0.125:15021: connect: connection refused"
Oct 30 21:18:50.696920 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:50.696873    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:50.815037 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:50.814983    6048 patch_prober.go:29] interesting pod/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.125:15021/healthz/ready\": dial tcp 10.134.0.125:15021: connect: connection refused" start-of-body=
Oct 30 21:18:50.815556 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:50.815052    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.125:15021/healthz/ready\": dial tcp 10.134.0.125:15021: connect: connection refused"
Oct 30 21:18:51.814633 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:51.814596    6048 patch_prober.go:29] interesting pod/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.125:15021/healthz/ready\": dial tcp 10.134.0.125:15021: connect: connection refused" start-of-body=
Oct 30 21:18:51.814815 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:51.814671    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.125:15021/healthz/ready\": dial tcp 10.134.0.125:15021: connect: connection refused"
Oct 30 21:18:52.814934 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:52.814898    6048 patch_prober.go:29] interesting pod/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.125:15021/healthz/ready\": dial tcp 10.134.0.125:15021: connect: connection refused" start-of-body=
Oct 30 21:18:52.815371 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:52.814953    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.125:15021/healthz/ready\": dial tcp 10.134.0.125:15021: connect: connection refused"
Oct 30 21:18:53.815044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:53.814992    6048 patch_prober.go:29] interesting pod/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.125:15021/healthz/ready\": dial tcp 10.134.0.125:15021: connect: connection refused" start-of-body=
Oct 30 21:18:53.815422 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:53.815056    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.125:15021/healthz/ready\": dial tcp 10.134.0.125:15021: connect: connection refused"
Oct 30 21:18:55.270773 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:55.270726    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:18:55.273482 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:18:55.273445    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:19:16.801530 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:19:16.801444    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:19:39.552550 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.552510    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"]
Oct 30 21:19:39.553610 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.553549    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf" podUID="a3124c9f-4d4c-47d1-bea0-3891d5815ff7" containerName="maas-api" containerID="cri-o://0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8" gracePeriod=30
Oct 30 21:19:39.717987 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.717942    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf" podUID="a3124c9f-4d4c-47d1-bea0-3891d5815ff7" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.126:8443/health\": dial tcp 10.134.0.126:8443: connect: connection refused"
Oct 30 21:19:39.836820 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.836796    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:19:39.981906 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.981856    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-metrics-certs\") pod \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") "
Oct 30 21:19:39.982392 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.981918    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-maas-api-tls\") pod \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") "
Oct 30 21:19:39.982392 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.982014    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-kube-api-access-ztpp5\" (UniqueName: \"kubernetes.io/projected/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-kube-api-access-ztpp5\") pod \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") "
Oct 30 21:19:39.982392 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.982277    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-openshift-service-ca\") pod \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\" (UID: \"a3124c9f-4d4c-47d1-bea0-3891d5815ff7\") "
Oct 30 21:19:39.983117 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.983087    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-openshift-service-ca" pod "a3124c9f-4d4c-47d1-bea0-3891d5815ff7" (UID: "a3124c9f-4d4c-47d1-bea0-3891d5815ff7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:39.983821 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.983793    6048 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-openshift-service-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:39.984882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.984850    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-kube-api-access-ztpp5" pod "a3124c9f-4d4c-47d1-bea0-3891d5815ff7" (UID: "a3124c9f-4d4c-47d1-bea0-3891d5815ff7"). InnerVolumeSpecName "kube-api-access-ztpp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:39.986076 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.986049    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-maas-api-tls" pod "a3124c9f-4d4c-47d1-bea0-3891d5815ff7" (UID: "a3124c9f-4d4c-47d1-bea0-3891d5815ff7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:39.987787 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:39.987759    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-metrics-certs" pod "a3124c9f-4d4c-47d1-bea0-3891d5815ff7" (UID: "a3124c9f-4d4c-47d1-bea0-3891d5815ff7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:40.073755 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:40.073671    6048 generic.go:356] "Generic (PLEG): container finished" podID="a3124c9f-4d4c-47d1-bea0-3891d5815ff7" containerID="0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8" exitCode=0
Oct 30 21:19:40.073755 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:40.073722    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"
Oct 30 21:19:40.073755 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:40.073739    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf" event={"ID":"a3124c9f-4d4c-47d1-bea0-3891d5815ff7","Type":"ContainerDied","Data":"0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8"}
Oct 30 21:19:40.074054 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:40.073782    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf" event={"ID":"a3124c9f-4d4c-47d1-bea0-3891d5815ff7","Type":"ContainerDied","Data":"6b4f8aaf2d5f92b2b287bfabce372be1365d516d9bd2a3b659027eb21ee83c82"}
Oct 30 21:19:40.074054 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:40.073805    6048 scope.go:122] "RemoveContainer" containerID="0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8"
Oct 30 21:19:40.083788 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:40.083770    6048 scope.go:122] "RemoveContainer" containerID="0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8"
Oct 30 21:19:40.084125 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:19:40.084099    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8\": container with ID starting with 0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8 not found: ID does not exist" containerID="0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8"
Oct 30 21:19:40.084216 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:40.084134    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8"} err="failed to get container status \"0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8\": rpc error: code = NotFound desc = could not find container \"0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8\": container with ID starting with 0e33aabddd465aa7f6ace13529d067426ad84ffde046077463d8138103546ab8 not found: ID does not exist"
Oct 30 21:19:40.084485 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:40.084466    6048 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-metrics-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:40.084551 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:40.084492    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-maas-api-tls\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:40.084551 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:40.084509    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztpp5\" (UniqueName: \"kubernetes.io/projected/a3124c9f-4d4c-47d1-bea0-3891d5815ff7-kube-api-access-ztpp5\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:40.096792 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:40.096766    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"]
Oct 30 21:19:40.098602 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:40.098580    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-11b629-6654756d69-958hf"]
Oct 30 21:19:41.257818 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:41.257785    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a3124c9f-4d4c-47d1-bea0-3891d5815ff7" path="/var/lib/kubelet/pods/a3124c9f-4d4c-47d1-bea0-3891d5815ff7/volumes"
Oct 30 21:19:46.802228 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:19:46.802180    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:19:47.366087 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:47.366048    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"]
Oct 30 21:19:47.366398 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:47.366339    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerName="istio-proxy" containerID="cri-o://cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09" gracePeriod=30
Oct 30 21:19:52.624419 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.624393    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:19:52.711889 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.711805    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-credential-socket\") pod \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") "
Oct 30 21:19:52.711889 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.711842    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-socket\") pod \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") "
Oct 30 21:19:52.711889 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.711864    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-token\" (UniqueName: \"kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-token\") pod \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") "
Oct 30 21:19:52.712222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.711939    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-kube-api-access-p9xx9\" (UniqueName: \"kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-kube-api-access-p9xx9\") pod \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") "
Oct 30 21:19:52.712222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.711971    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-certs\") pod \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") "
Oct 30 21:19:52.712222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712099    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istiod-ca-cert\") pod \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") "
Oct 30 21:19:52.712222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712127    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-envoy\") pod \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") "
Oct 30 21:19:52.712222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712145    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-credential-socket" pod "cc0970b0-9997-4ab8-ac6f-2d8f602cd209" (UID: "cc0970b0-9997-4ab8-ac6f-2d8f602cd209"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:52.712222 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712176    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-data\") pod \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") "
Oct 30 21:19:52.712541 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712295    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-podinfo\") pod \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\" (UID: \"cc0970b0-9997-4ab8-ac6f-2d8f602cd209\") "
Oct 30 21:19:52.712541 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712360    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-certs" pod "cc0970b0-9997-4ab8-ac6f-2d8f602cd209" (UID: "cc0970b0-9997-4ab8-ac6f-2d8f602cd209"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:52.712541 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712416    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-data" pod "cc0970b0-9997-4ab8-ac6f-2d8f602cd209" (UID: "cc0970b0-9997-4ab8-ac6f-2d8f602cd209"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:52.712677 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712565    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istiod-ca-cert" pod "cc0970b0-9997-4ab8-ac6f-2d8f602cd209" (UID: "cc0970b0-9997-4ab8-ac6f-2d8f602cd209"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:52.712677 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712569    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-socket" pod "cc0970b0-9997-4ab8-ac6f-2d8f602cd209" (UID: "cc0970b0-9997-4ab8-ac6f-2d8f602cd209"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:52.712845 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712821    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:52.712899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712850    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:52.712899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712864    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:52.712899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712882    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:52.712899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.712896    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:52.714350 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.714331    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-podinfo" pod "cc0970b0-9997-4ab8-ac6f-2d8f602cd209" (UID: "cc0970b0-9997-4ab8-ac6f-2d8f602cd209"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:19:52.714430 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.714376    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-envoy" pod "cc0970b0-9997-4ab8-ac6f-2d8f602cd209" (UID: "cc0970b0-9997-4ab8-ac6f-2d8f602cd209"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:52.714664 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.714639    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-kube-api-access-p9xx9" pod "cc0970b0-9997-4ab8-ac6f-2d8f602cd209" (UID: "cc0970b0-9997-4ab8-ac6f-2d8f602cd209"). InnerVolumeSpecName "kube-api-access-p9xx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:52.714763 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.714661    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-token" pod "cc0970b0-9997-4ab8-ac6f-2d8f602cd209" (UID: "cc0970b0-9997-4ab8-ac6f-2d8f602cd209"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:52.813458 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.813429    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:52.813458 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.813457    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:52.813654 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.813467    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:52.813654 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:52.813475    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9xx9\" (UniqueName: \"kubernetes.io/projected/cc0970b0-9997-4ab8-ac6f-2d8f602cd209-kube-api-access-p9xx9\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:19:53.137955 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.137918    6048 generic.go:356] "Generic (PLEG): container finished" podID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerID="cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09" exitCode=0
Oct 30 21:19:53.138158 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.137974    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"
Oct 30 21:19:53.138158 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.138000    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" event={"ID":"cc0970b0-9997-4ab8-ac6f-2d8f602cd209","Type":"ContainerDied","Data":"cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09"}
Oct 30 21:19:53.138158 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.138090    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2" event={"ID":"cc0970b0-9997-4ab8-ac6f-2d8f602cd209","Type":"ContainerDied","Data":"30d82ec2b40772e69a8fbae93036a2c82c9c355908104ec0c9a61d8101a4ad4c"}
Oct 30 21:19:53.138158 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.138115    6048 scope.go:122] "RemoveContainer" containerID="cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09"
Oct 30 21:19:53.148017 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.147998    6048 scope.go:122] "RemoveContainer" containerID="1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd"
Oct 30 21:19:53.156125 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.156106    6048 scope.go:122] "RemoveContainer" containerID="cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09"
Oct 30 21:19:53.156384 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:19:53.156366    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09\": container with ID starting with cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09 not found: ID does not exist" containerID="cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09"
Oct 30 21:19:53.156453 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.156390    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09"} err="failed to get container status \"cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09\": rpc error: code = NotFound desc = could not find container \"cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09\": container with ID starting with cc8ed5532cbd8701ebab0026d8248a5f5a6e66f38e6567fa6b5d5c9f91e9dc09 not found: ID does not exist"
Oct 30 21:19:53.156453 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.156406    6048 scope.go:122] "RemoveContainer" containerID="1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd"
Oct 30 21:19:53.156635 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:19:53.156617    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd\": container with ID starting with 1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd not found: ID does not exist" containerID="1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd"
Oct 30 21:19:53.156675 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.156639    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd"} err="failed to get container status \"1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd\": rpc error: code = NotFound desc = could not find container \"1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd\": container with ID starting with 1593e00f9840edcd9ceeec9ca2c59cf485e94fc5596197f8ef4a1dd4a6dd44cd not found: ID does not exist"
Oct 30 21:19:53.160860 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.160837    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"]
Oct 30 21:19:53.164893 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.164859    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-single-main-11b629-openshift-default-9555bc7-2f2j2"]
Oct 30 21:19:53.258358 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:53.258328    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" path="/var/lib/kubelet/pods/cc0970b0-9997-4ab8-ac6f-2d8f602cd209/volumes"
Oct 30 21:19:56.856047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:56.853128    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-gddkd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:19:56.856047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:56.853207    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-gddkd" podUID="794efeb8-0f81-4915-bbbd-80699907b7f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.122:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:19:56.858052 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:56.857107    6048 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-58c6585447-q29bh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.121:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:19:56.858052 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:19:56.857161    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-58c6585447-q29bh" podUID="ad4e2a15-d67f-4ea2-b876-b9dc237497a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.121:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:20:08.191860 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.191822    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"]
Oct 30 21:20:08.192500 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.192482    6048 cpu_manager.go:414] "containerMap: removing container" podUID="a3124c9f-4d4c-47d1-bea0-3891d5815ff7" containerName="maas-api"
Oct 30 21:20:08.192545 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.192503    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3124c9f-4d4c-47d1-bea0-3891d5815ff7" containerName="maas-api"
Oct 30 21:20:08.192545 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.192520    6048 cpu_manager.go:414] "containerMap: removing container" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerName="istio-proxy"
Oct 30 21:20:08.192545 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.192528    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerName="istio-proxy"
Oct 30 21:20:08.192638 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.192567    6048 cpu_manager.go:414] "containerMap: removing container" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerName="istio-proxy"
Oct 30 21:20:08.192638 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.192575    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerName="istio-proxy"
Oct 30 21:20:08.192705 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.192693    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3124c9f-4d4c-47d1-bea0-3891d5815ff7" containerName="maas-api"
Oct 30 21:20:08.192738 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.192709    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerName="istio-proxy"
Oct 30 21:20:08.198001 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.197983    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.204342 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.204316    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-3f8108d8-kserve-self-signed-certs\""
Oct 30 21:20:08.205865 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.205841    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"]
Oct 30 21:20:08.217671 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.217647    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-model-cache\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.217787 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.217689    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prl9g\" (UniqueName: \"kubernetes.io/projected/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-kube-api-access-prl9g\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.217838 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.217806    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-dshm\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.217838 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.217835    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tls-certs\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.217955 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.217927    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tmp-dir\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.218055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.218007    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-home\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.319575 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.319541    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tmp-dir\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.319779 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.319603    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-home\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.319779 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.319637    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-model-cache\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.319779 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.319682    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prl9g\" (UniqueName: \"kubernetes.io/projected/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-kube-api-access-prl9g\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.319779 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.319760    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-dshm\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.320015 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.319798    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tls-certs\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.320399 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.320049    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tmp-dir\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.320399 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.320125    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-home\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.320399 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.320355    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-model-cache\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.322673 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.322647    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tls-certs\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.322782 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.322709    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-dshm\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.335282 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.335243    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prl9g\" (UniqueName: \"kubernetes.io/projected/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-kube-api-access-prl9g\") pod \"e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") " pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.512680 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.512590    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:08.788612 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:08.788570    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"]
Oct 30 21:20:08.790606 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:20:08.790573    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ff4e01e_d58b_40a5_b4a8_4528591a1d23.slice/crio-1c11fd420b8c33c2eef083acda591ed589980f9e6af3b0a2266e0aab6ed68809 WatchSource:0}: Error finding container 1c11fd420b8c33c2eef083acda591ed589980f9e6af3b0a2266e0aab6ed68809: Status 404 returned error can't find the container with id 1c11fd420b8c33c2eef083acda591ed589980f9e6af3b0a2266e0aab6ed68809
Oct 30 21:20:09.244002 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:09.243954    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj" event={"ID":"1ff4e01e-d58b-40a5-b4a8-4528591a1d23","Type":"ContainerStarted","Data":"b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb"}
Oct 30 21:20:09.244507 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:09.244010    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj" event={"ID":"1ff4e01e-d58b-40a5-b4a8-4528591a1d23","Type":"ContainerStarted","Data":"1c11fd420b8c33c2eef083acda591ed589980f9e6af3b0a2266e0aab6ed68809"}
Oct 30 21:20:09.264541 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:09.264465    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj" podStartSLOduration=1.2644520479999999 podStartE2EDuration="1.264452048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:20:09.263450643 +0000 UTC m=+2420.122186937" watchObservedRunningTime="2026-10-30 21:20:09.264452048 +0000 UTC m=+2420.123188340"
Oct 30 21:20:09.513607 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:09.513524    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:16.800779 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:20:16.800738    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:20:18.513365 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:18.513328    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:18.526075 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:18.526046    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:19.340150 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:19.340119    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:25.421169 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.421125    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"]
Oct 30 21:20:25.421755 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.421734    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc0970b0-9997-4ab8-ac6f-2d8f602cd209" containerName="istio-proxy"
Oct 30 21:20:25.424939 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.424921    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:25.428654 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.428632    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:20:25.429731 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.429709    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:20:25.429839 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.429753    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:20:25.434603 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.434574    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"]
Oct 30 21:20:25.528842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.528813    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:20:25.544378 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.544345    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-254lh\" (UniqueName: \"kubernetes.io/projected/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-kube-api-access-254lh\") pod \"maas-api-revoke-sub-452b6d7b-xq4h2\" (UID: \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:25.544524 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.544405    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-xq4h2\" (UID: \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:25.544565 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.544540    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-xq4h2\" (UID: \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:25.646093 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.646056    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-254lh\" (UniqueName: \"kubernetes.io/projected/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-kube-api-access-254lh\") pod \"maas-api-revoke-sub-452b6d7b-xq4h2\" (UID: \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:25.646303 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.646122    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-xq4h2\" (UID: \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:25.646303 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.646176    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-xq4h2\" (UID: \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:25.646809 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.646790    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-452b6d7b-xq4h2\" (UID: \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:25.648558 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.648537    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-452b6d7b-xq4h2\" (UID: \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:25.658357 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.658334    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-254lh\" (UniqueName: \"kubernetes.io/projected/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-kube-api-access-254lh\") pod \"maas-api-revoke-sub-452b6d7b-xq4h2\" (UID: \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:25.739284 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:25.739205    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:26.011534 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:26.011509    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"]
Oct 30 21:20:26.014050 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:20:26.014004    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850baea6_ac13_40bb_a0b8_59db3a4cb9f9.slice/crio-c14c4431ba4a80a64d51ecd93ccbea57ce1532998beca1967d350491945206d3 WatchSource:0}: Error finding container c14c4431ba4a80a64d51ecd93ccbea57ce1532998beca1967d350491945206d3: Status 404 returned error can't find the container with id c14c4431ba4a80a64d51ecd93ccbea57ce1532998beca1967d350491945206d3
Oct 30 21:20:26.361997 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:26.361959    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2" event={"ID":"850baea6-ac13-40bb-a0b8-59db3a4cb9f9","Type":"ContainerStarted","Data":"8db921357a6ea1689eae7d4c4fd3c2df71c6397318e14728ab7028bd4c97977f"}
Oct 30 21:20:26.362231 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:26.362035    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2" event={"ID":"850baea6-ac13-40bb-a0b8-59db3a4cb9f9","Type":"ContainerStarted","Data":"c14c4431ba4a80a64d51ecd93ccbea57ce1532998beca1967d350491945206d3"}
Oct 30 21:20:27.369862 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:27.369822    6048 generic.go:356] "Generic (PLEG): container finished" podID="850baea6-ac13-40bb-a0b8-59db3a4cb9f9" containerID="8db921357a6ea1689eae7d4c4fd3c2df71c6397318e14728ab7028bd4c97977f" exitCode=0
Oct 30 21:20:27.370403 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:27.369906    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2" event={"ID":"850baea6-ac13-40bb-a0b8-59db3a4cb9f9","Type":"ContainerDied","Data":"8db921357a6ea1689eae7d4c4fd3c2df71c6397318e14728ab7028bd4c97977f"}
Oct 30 21:20:28.794231 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:28.794198    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:28.923610 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:28.923557    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-kube-api-access-254lh\" (UniqueName: \"kubernetes.io/projected/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-kube-api-access-254lh\") pod \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\" (UID: \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\") "
Oct 30 21:20:28.923823 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:28.923647    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-xks-ca\") pod \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\" (UID: \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\") "
Oct 30 21:20:28.923823 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:28.923750    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-openshift-ca\") pod \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\" (UID: \"850baea6-ac13-40bb-a0b8-59db3a4cb9f9\") "
Oct 30 21:20:28.924230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:28.924115    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-openshift-ca" pod "850baea6-ac13-40bb-a0b8-59db3a4cb9f9" (UID: "850baea6-ac13-40bb-a0b8-59db3a4cb9f9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:20:28.924373 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:28.924271    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:28.926173 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:28.926144    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-xks-ca" pod "850baea6-ac13-40bb-a0b8-59db3a4cb9f9" (UID: "850baea6-ac13-40bb-a0b8-59db3a4cb9f9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:20:28.926294 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:28.926205    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-kube-api-access-254lh" pod "850baea6-ac13-40bb-a0b8-59db3a4cb9f9" (UID: "850baea6-ac13-40bb-a0b8-59db3a4cb9f9"). InnerVolumeSpecName "kube-api-access-254lh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:20:29.025450 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:29.025362    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-254lh\" (UniqueName: \"kubernetes.io/projected/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-kube-api-access-254lh\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:29.025450 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:29.025394    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/850baea6-ac13-40bb-a0b8-59db3a4cb9f9-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:29.414509 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:29.414479    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"
Oct 30 21:20:29.414509 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:29.414496    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2" event={"ID":"850baea6-ac13-40bb-a0b8-59db3a4cb9f9","Type":"ContainerDied","Data":"c14c4431ba4a80a64d51ecd93ccbea57ce1532998beca1967d350491945206d3"}
Oct 30 21:20:29.414711 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:29.414590    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c14c4431ba4a80a64d51ecd93ccbea57ce1532998beca1967d350491945206d3"
Oct 30 21:20:38.026016 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:38.025929    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"]
Oct 30 21:20:41.582729 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.582695    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"]
Oct 30 21:20:41.583177 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.583162    6048 cpu_manager.go:414] "containerMap: removing container" podUID="850baea6-ac13-40bb-a0b8-59db3a4cb9f9" containerName="revoke-keys"
Oct 30 21:20:41.583236 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.583179    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="850baea6-ac13-40bb-a0b8-59db3a4cb9f9" containerName="revoke-keys"
Oct 30 21:20:41.583317 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.583306    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="850baea6-ac13-40bb-a0b8-59db3a4cb9f9" containerName="revoke-keys"
Oct 30 21:20:41.586698 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.586673    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:41.592042 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.592002    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:20:41.592179 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.592047    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:20:41.592179 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.592142    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:20:41.592294 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.592209    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:20:41.597311 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.597284    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"]
Oct 30 21:20:41.683218 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.683181    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-wrxdz\" (UID: \"bff38ac2-e265-473a-80d3-0cd375b5353d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:41.683382 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.683237    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22gm9\" (UniqueName: \"kubernetes.io/projected/bff38ac2-e265-473a-80d3-0cd375b5353d-kube-api-access-22gm9\") pod \"maas-api-revoke-sub-3e31a506-wrxdz\" (UID: \"bff38ac2-e265-473a-80d3-0cd375b5353d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:41.683382 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.683294    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-wrxdz\" (UID: \"bff38ac2-e265-473a-80d3-0cd375b5353d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:41.783969 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.783928    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-wrxdz\" (UID: \"bff38ac2-e265-473a-80d3-0cd375b5353d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:41.784193 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.783998    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22gm9\" (UniqueName: \"kubernetes.io/projected/bff38ac2-e265-473a-80d3-0cd375b5353d-kube-api-access-22gm9\") pod \"maas-api-revoke-sub-3e31a506-wrxdz\" (UID: \"bff38ac2-e265-473a-80d3-0cd375b5353d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:41.784193 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.784052    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-wrxdz\" (UID: \"bff38ac2-e265-473a-80d3-0cd375b5353d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:41.784580 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.784557    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3e31a506-wrxdz\" (UID: \"bff38ac2-e265-473a-80d3-0cd375b5353d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:41.786492 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.786469    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3e31a506-wrxdz\" (UID: \"bff38ac2-e265-473a-80d3-0cd375b5353d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:41.796879 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.796855    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22gm9\" (UniqueName: \"kubernetes.io/projected/bff38ac2-e265-473a-80d3-0cd375b5353d-kube-api-access-22gm9\") pod \"maas-api-revoke-sub-3e31a506-wrxdz\" (UID: \"bff38ac2-e265-473a-80d3-0cd375b5353d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:41.902983 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:41.902889    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:42.201882 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:42.201852    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"]
Oct 30 21:20:42.205346 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:20:42.205307    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff38ac2_e265_473a_80d3_0cd375b5353d.slice/crio-81ed5f71ed2f61c8c3cd988844f80938bb273f9bb2271f2d04dc7245638cc527 WatchSource:0}: Error finding container 81ed5f71ed2f61c8c3cd988844f80938bb273f9bb2271f2d04dc7245638cc527: Status 404 returned error can't find the container with id 81ed5f71ed2f61c8c3cd988844f80938bb273f9bb2271f2d04dc7245638cc527
Oct 30 21:20:42.538950 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:42.537774    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz" event={"ID":"bff38ac2-e265-473a-80d3-0cd375b5353d","Type":"ContainerStarted","Data":"b820f1fce08347bf5f5c581aa32dc54ddd83264443bf738a425cf375098d8d84"}
Oct 30 21:20:42.538950 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:42.537877    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz" event={"ID":"bff38ac2-e265-473a-80d3-0cd375b5353d","Type":"ContainerStarted","Data":"81ed5f71ed2f61c8c3cd988844f80938bb273f9bb2271f2d04dc7245638cc527"}
Oct 30 21:20:42.564514 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:42.564448    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz" podStartSLOduration=1.5644342020000002 podStartE2EDuration="1.564434202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:20:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:20:42.563427431 +0000 UTC m=+2453.422163728" watchObservedRunningTime="2026-10-30 21:20:42.564434202 +0000 UTC m=+2453.423170494"
Oct 30 21:20:43.134313 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:20:43.134279    6048 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff38ac2_e265_473a_80d3_0cd375b5353d.slice/crio-conmon-b820f1fce08347bf5f5c581aa32dc54ddd83264443bf738a425cf375098d8d84.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:20:43.563104 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:43.559705    6048 generic.go:356] "Generic (PLEG): container finished" podID="bff38ac2-e265-473a-80d3-0cd375b5353d" containerID="b820f1fce08347bf5f5c581aa32dc54ddd83264443bf738a425cf375098d8d84" exitCode=0
Oct 30 21:20:43.563104 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:43.559765    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz" event={"ID":"bff38ac2-e265-473a-80d3-0cd375b5353d","Type":"ContainerDied","Data":"b820f1fce08347bf5f5c581aa32dc54ddd83264443bf738a425cf375098d8d84"}
Oct 30 21:20:44.704541 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:44.704508    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:44.836905 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:44.836825    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-openshift-ca\") pod \"bff38ac2-e265-473a-80d3-0cd375b5353d\" (UID: \"bff38ac2-e265-473a-80d3-0cd375b5353d\") "
Oct 30 21:20:44.836905 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:44.836904    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bff38ac2-e265-473a-80d3-0cd375b5353d-kube-api-access-22gm9\" (UniqueName: \"kubernetes.io/projected/bff38ac2-e265-473a-80d3-0cd375b5353d-kube-api-access-22gm9\") pod \"bff38ac2-e265-473a-80d3-0cd375b5353d\" (UID: \"bff38ac2-e265-473a-80d3-0cd375b5353d\") "
Oct 30 21:20:44.837165 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:44.837015    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-xks-ca\") pod \"bff38ac2-e265-473a-80d3-0cd375b5353d\" (UID: \"bff38ac2-e265-473a-80d3-0cd375b5353d\") "
Oct 30 21:20:44.837231 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:44.837167    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-openshift-ca" pod "bff38ac2-e265-473a-80d3-0cd375b5353d" (UID: "bff38ac2-e265-473a-80d3-0cd375b5353d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:20:44.837319 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:44.837304    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:44.838899 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:44.838864    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-xks-ca" pod "bff38ac2-e265-473a-80d3-0cd375b5353d" (UID: "bff38ac2-e265-473a-80d3-0cd375b5353d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:20:44.838987 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:44.838923    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bff38ac2-e265-473a-80d3-0cd375b5353d-kube-api-access-22gm9" pod "bff38ac2-e265-473a-80d3-0cd375b5353d" (UID: "bff38ac2-e265-473a-80d3-0cd375b5353d"). InnerVolumeSpecName "kube-api-access-22gm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:20:44.937982 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:44.937953    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22gm9\" (UniqueName: \"kubernetes.io/projected/bff38ac2-e265-473a-80d3-0cd375b5353d-kube-api-access-22gm9\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:44.937982 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:44.937980    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bff38ac2-e265-473a-80d3-0cd375b5353d-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:45.571226 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:45.571194    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"
Oct 30 21:20:45.571388 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:45.571233    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz" event={"ID":"bff38ac2-e265-473a-80d3-0cd375b5353d","Type":"ContainerDied","Data":"81ed5f71ed2f61c8c3cd988844f80938bb273f9bb2271f2d04dc7245638cc527"}
Oct 30 21:20:45.571388 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:45.571294    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81ed5f71ed2f61c8c3cd988844f80938bb273f9bb2271f2d04dc7245638cc527"
Oct 30 21:20:46.800218 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:20:46.800175    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:20:51.190641 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:51.190602    6048 scope.go:122] "RemoveContainer" containerID="da50f287647feede7b545b83593d9204144f4ec25ee27626b0313baa2429caa4"
Oct 30 21:20:52.024604 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:52.024560    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"]
Oct 30 21:20:52.027251 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:52.027219    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-9pkk7"]
Oct 30 21:20:53.057383 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.057295    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj" podUID="1ff4e01e-d58b-40a5-b4a8-4528591a1d23" containerName="main" containerID="cri-o://b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb" gracePeriod=45
Oct 30 21:20:53.288803 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.288764    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72f2d901-fed1-4ec4-8762-cc21d4f2cf03" path="/var/lib/kubelet/pods/72f2d901-fed1-4ec4-8762-cc21d4f2cf03/volumes"
Oct 30 21:20:53.324579 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.324480    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj" podUID="1ff4e01e-d58b-40a5-b4a8-4528591a1d23" containerName="main" probeResult="failure" output="Get \"https://10.134.0.127:8000/ready\": dial tcp 10.134.0.127:8000: connect: connection refused"
Oct 30 21:20:53.606666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.606299    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:53.627945 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.626874    6048 generic.go:356] "Generic (PLEG): container finished" podID="1ff4e01e-d58b-40a5-b4a8-4528591a1d23" containerID="b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb" exitCode=0
Oct 30 21:20:53.627945 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.626929    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"
Oct 30 21:20:53.627945 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.626949    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj" event={"ID":"1ff4e01e-d58b-40a5-b4a8-4528591a1d23","Type":"ContainerDied","Data":"b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb"}
Oct 30 21:20:53.627945 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.626977    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj" event={"ID":"1ff4e01e-d58b-40a5-b4a8-4528591a1d23","Type":"ContainerDied","Data":"1c11fd420b8c33c2eef083acda591ed589980f9e6af3b0a2266e0aab6ed68809"}
Oct 30 21:20:53.627945 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.627010    6048 scope.go:122] "RemoveContainer" containerID="b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb"
Oct 30 21:20:53.653095 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.652181    6048 scope.go:122] "RemoveContainer" containerID="b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb"
Oct 30 21:20:53.654297 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:20:53.654166    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb\": container with ID starting with b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb not found: ID does not exist" containerID="b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb"
Oct 30 21:20:53.654297 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.654218    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb"} err="failed to get container status \"b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb\": rpc error: code = NotFound desc = could not find container \"b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb\": container with ID starting with b377d0b7e26088f4f1a86b15c1796dffa752264116248904e17240f2f92479eb not found: ID does not exist"
Oct 30 21:20:53.736250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.735464    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tls-certs\") pod \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") "
Oct 30 21:20:53.736250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.735534    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tmp-dir\") pod \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") "
Oct 30 21:20:53.736250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.735584    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-dshm\") pod \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") "
Oct 30 21:20:53.736250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.735608    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-home\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-home\") pod \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") "
Oct 30 21:20:53.736250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.735635    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-model-cache\") pod \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") "
Oct 30 21:20:53.736250 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.735738    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-kube-api-access-prl9g\" (UniqueName: \"kubernetes.io/projected/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-kube-api-access-prl9g\") pod \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\" (UID: \"1ff4e01e-d58b-40a5-b4a8-4528591a1d23\") "
Oct 30 21:20:53.737237 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.736933    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-home" pod "1ff4e01e-d58b-40a5-b4a8-4528591a1d23" (UID: "1ff4e01e-d58b-40a5-b4a8-4528591a1d23"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:20:53.738291 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.738184    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-model-cache" pod "1ff4e01e-d58b-40a5-b4a8-4528591a1d23" (UID: "1ff4e01e-d58b-40a5-b4a8-4528591a1d23"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:20:53.738291 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.738257    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tmp-dir" pod "1ff4e01e-d58b-40a5-b4a8-4528591a1d23" (UID: "1ff4e01e-d58b-40a5-b4a8-4528591a1d23"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:20:53.739317 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.739276    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-kube-api-access-prl9g" pod "1ff4e01e-d58b-40a5-b4a8-4528591a1d23" (UID: "1ff4e01e-d58b-40a5-b4a8-4528591a1d23"). InnerVolumeSpecName "kube-api-access-prl9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:20:53.740359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.740080    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tls-certs" pod "1ff4e01e-d58b-40a5-b4a8-4528591a1d23" (UID: "1ff4e01e-d58b-40a5-b4a8-4528591a1d23"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:20:53.740359 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.740182    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-dshm" pod "1ff4e01e-d58b-40a5-b4a8-4528591a1d23" (UID: "1ff4e01e-d58b-40a5-b4a8-4528591a1d23"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:20:53.837366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.837284    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prl9g\" (UniqueName: \"kubernetes.io/projected/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-kube-api-access-prl9g\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.837366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.837313    6048 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tls-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.837366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.837325    6048 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-tmp-dir\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.837366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.837334    6048 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-dshm\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.837366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.837343    6048 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-home\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.837366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.837352    6048 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ff4e01e-d58b-40a5-b4a8-4528591a1d23-model-cache\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.957045 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.952063    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"]
Oct 30 21:20:53.974044 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:53.970973    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-3f8108d8-kserve-ff5cf497c-mlxjj"]
Oct 30 21:20:55.261005 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:20:55.260962    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ff4e01e-d58b-40a5-b4a8-4528591a1d23" path="/var/lib/kubelet/pods/1ff4e01e-d58b-40a5-b4a8-4528591a1d23/volumes"
Oct 30 21:21:02.186606 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.186566    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"]
Oct 30 21:21:02.187011 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.186998    6048 cpu_manager.go:414] "containerMap: removing container" podUID="1ff4e01e-d58b-40a5-b4a8-4528591a1d23" containerName="main"
Oct 30 21:21:02.187090 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.187012    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ff4e01e-d58b-40a5-b4a8-4528591a1d23" containerName="main"
Oct 30 21:21:02.187090 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.187053    6048 cpu_manager.go:414] "containerMap: removing container" podUID="bff38ac2-e265-473a-80d3-0cd375b5353d" containerName="revoke-keys"
Oct 30 21:21:02.187090 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.187059    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bff38ac2-e265-473a-80d3-0cd375b5353d" containerName="revoke-keys"
Oct 30 21:21:02.187204 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.187142    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="bff38ac2-e265-473a-80d3-0cd375b5353d" containerName="revoke-keys"
Oct 30 21:21:02.187204 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.187158    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ff4e01e-d58b-40a5-b4a8-4528591a1d23" containerName="main"
Oct 30 21:21:02.191563 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.191547    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:02.197318 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.197291    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:21:02.199012 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.198566    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:21:02.199012 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.198627    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:21:02.199158 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.199137    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c45pw\""
Oct 30 21:21:02.199530 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.199505    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"]
Oct 30 21:21:02.260190 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.260156    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-948e54d7-5h4rc\" (UID: \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:02.260190 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.260192    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x246f\" (UniqueName: \"kubernetes.io/projected/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-kube-api-access-x246f\") pod \"maas-api-revoke-sub-948e54d7-5h4rc\" (UID: \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:02.260377 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.260278    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-948e54d7-5h4rc\" (UID: \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:02.360866 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.360832    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-948e54d7-5h4rc\" (UID: \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:02.360866 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.360869    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x246f\" (UniqueName: \"kubernetes.io/projected/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-kube-api-access-x246f\") pod \"maas-api-revoke-sub-948e54d7-5h4rc\" (UID: \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:02.361105 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.360901    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-948e54d7-5h4rc\" (UID: \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:02.361551 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.361529    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-948e54d7-5h4rc\" (UID: \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:02.363241 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.363223    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-948e54d7-5h4rc\" (UID: \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:02.378642 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.378620    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x246f\" (UniqueName: \"kubernetes.io/projected/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-kube-api-access-x246f\") pod \"maas-api-revoke-sub-948e54d7-5h4rc\" (UID: \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:02.506727 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.506643    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:02.785473 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:02.785431    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"]
Oct 30 21:21:02.788369 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:21:02.788336    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a3b4c2_7c0e_4335_8c01_245f7eb7b20e.slice/crio-5a2e5857ada3848ce2ec1883bd9971df4eb4596af1947cb1568ff7a7c3cf6100 WatchSource:0}: Error finding container 5a2e5857ada3848ce2ec1883bd9971df4eb4596af1947cb1568ff7a7c3cf6100: Status 404 returned error can't find the container with id 5a2e5857ada3848ce2ec1883bd9971df4eb4596af1947cb1568ff7a7c3cf6100
Oct 30 21:21:03.746075 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:03.746006    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc" event={"ID":"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e","Type":"ContainerStarted","Data":"86dc47d1593dd744a46177f084d0f27c12cac877363bb5332d101a5edc396719"}
Oct 30 21:21:03.746523 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:03.746107    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc" event={"ID":"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e","Type":"ContainerStarted","Data":"5a2e5857ada3848ce2ec1883bd9971df4eb4596af1947cb1568ff7a7c3cf6100"}
Oct 30 21:21:03.767390 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:03.767346    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc" podStartSLOduration=1.767329961 podStartE2EDuration="1.767329961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:03.766429279 +0000 UTC m=+2474.625165572" watchObservedRunningTime="2026-10-30 21:21:03.767329961 +0000 UTC m=+2474.626066254"
Oct 30 21:21:04.753535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:04.753486    6048 generic.go:356] "Generic (PLEG): container finished" podID="b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e" containerID="86dc47d1593dd744a46177f084d0f27c12cac877363bb5332d101a5edc396719" exitCode=0
Oct 30 21:21:04.753938 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:04.753558    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc" event={"ID":"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e","Type":"ContainerDied","Data":"86dc47d1593dd744a46177f084d0f27c12cac877363bb5332d101a5edc396719"}
Oct 30 21:21:05.895318 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:05.895292    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:06.000230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:06.000192    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-openshift-ca\") pod \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\" (UID: \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\") "
Oct 30 21:21:06.000230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:06.000237    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-kube-api-access-x246f\" (UniqueName: \"kubernetes.io/projected/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-kube-api-access-x246f\") pod \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\" (UID: \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\") "
Oct 30 21:21:06.000502 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:06.000260    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-xks-ca\") pod \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\" (UID: \"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e\") "
Oct 30 21:21:06.000569 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:06.000551    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-openshift-ca" pod "b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e" (UID: "b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:21:06.002404 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:06.002371    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-kube-api-access-x246f" pod "b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e" (UID: "b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e"). InnerVolumeSpecName "kube-api-access-x246f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:06.002506 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:06.002401    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-xks-ca" pod "b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e" (UID: "b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:21:06.101939 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:06.101904    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-openshift-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:06.101939 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:06.101933    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x246f\" (UniqueName: \"kubernetes.io/projected/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-kube-api-access-x246f\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:06.101939 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:06.101944    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e-maas-api-xks-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:06.764625 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:06.764594    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"
Oct 30 21:21:06.764625 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:06.764610    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc" event={"ID":"b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e","Type":"ContainerDied","Data":"5a2e5857ada3848ce2ec1883bd9971df4eb4596af1947cb1568ff7a7c3cf6100"}
Oct 30 21:21:06.764833 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:06.764653    6048 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a2e5857ada3848ce2ec1883bd9971df4eb4596af1947cb1568ff7a7c3cf6100"
Oct 30 21:21:14.525984 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.525945    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6797b9d996-bd495"]
Oct 30 21:21:14.526456 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.526440    6048 cpu_manager.go:414] "containerMap: removing container" podUID="b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e" containerName="revoke-keys"
Oct 30 21:21:14.526507 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.526457    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e" containerName="revoke-keys"
Oct 30 21:21:14.526540 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.526531    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e" containerName="revoke-keys"
Oct 30 21:21:14.529376 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.529352    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.533789 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.533762    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 21:21:14.533922 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.533905    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:21:14.541845 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.541820    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6797b9d996-bd495"]
Oct 30 21:21:14.587921 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.587873    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt5w6\" (UniqueName: \"kubernetes.io/projected/ee4819aa-b074-4aa5-a253-f50e935704d0-kube-api-access-bt5w6\") pod \"maas-api-6797b9d996-bd495\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.588139 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.587934    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-maas-api-tls\") pod \"maas-api-6797b9d996-bd495\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.588209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.588151    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4819aa-b074-4aa5-a253-f50e935704d0-openshift-service-ca\") pod \"maas-api-6797b9d996-bd495\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.588209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.588196    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-metrics-certs\") pod \"maas-api-6797b9d996-bd495\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.634081 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.634047    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-57jm5\""
Oct 30 21:21:14.634321 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.634301    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 21:21:14.634426 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.634369    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:21:14.689506 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.689470    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt5w6\" (UniqueName: \"kubernetes.io/projected/ee4819aa-b074-4aa5-a253-f50e935704d0-kube-api-access-bt5w6\") pod \"maas-api-6797b9d996-bd495\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.689506 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.689508    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-maas-api-tls\") pod \"maas-api-6797b9d996-bd495\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.689749 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.689578    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4819aa-b074-4aa5-a253-f50e935704d0-openshift-service-ca\") pod \"maas-api-6797b9d996-bd495\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.689749 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.689598    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-metrics-certs\") pod \"maas-api-6797b9d996-bd495\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.690328 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.690306    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4819aa-b074-4aa5-a253-f50e935704d0-openshift-service-ca\") pod \"maas-api-6797b9d996-bd495\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.692133 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.692112    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-metrics-certs\") pod \"maas-api-6797b9d996-bd495\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.692217 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.692159    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-maas-api-tls\") pod \"maas-api-6797b9d996-bd495\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.702447 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.702424    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt5w6\" (UniqueName: \"kubernetes.io/projected/ee4819aa-b074-4aa5-a253-f50e935704d0-kube-api-access-bt5w6\") pod \"maas-api-6797b9d996-bd495\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") " pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:14.843603 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:14.843575    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:15.124356 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:15.124322    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6797b9d996-bd495"]
Oct 30 21:21:15.126787 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:21:15.126760    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4819aa_b074_4aa5_a253_f50e935704d0.slice/crio-fe2d82b5ca8b44a28bf115b113c1e8a4c89d75012deaaf9b79efaab5de53517d WatchSource:0}: Error finding container fe2d82b5ca8b44a28bf115b113c1e8a4c89d75012deaaf9b79efaab5de53517d: Status 404 returned error can't find the container with id fe2d82b5ca8b44a28bf115b113c1e8a4c89d75012deaaf9b79efaab5de53517d
Oct 30 21:21:15.128096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:15.128076    6048 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:21:15.811857 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:15.811824    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495" event={"ID":"ee4819aa-b074-4aa5-a253-f50e935704d0","Type":"ContainerStarted","Data":"d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394"}
Oct 30 21:21:15.812253 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:15.811876    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495" event={"ID":"ee4819aa-b074-4aa5-a253-f50e935704d0","Type":"ContainerStarted","Data":"fe2d82b5ca8b44a28bf115b113c1e8a4c89d75012deaaf9b79efaab5de53517d"}
Oct 30 21:21:15.812253 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:15.811912    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:15.832404 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:15.832356    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495" podStartSLOduration=1.332466575 podStartE2EDuration="1.83234291s" totalImagesPullingTime="499.876335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:15.831972927 +0000 UTC m=+2486.690709221" watchObservedRunningTime="2026-10-30 21:21:15.83234291 +0000 UTC m=+2486.691079202"
Oct 30 21:21:16.802002 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:21:16.801965    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:21:21.759538 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.759506    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"]
Oct 30 21:21:21.763395 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.763368    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.767535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.767512    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-68a46da4-openshift-default-dockercfg-5nxgd\""
Oct 30 21:21:21.779290 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.779267    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"]
Oct 30 21:21:21.823917 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.823891    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:21.865080 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.865018    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-socket\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.865247 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.865130    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbrh2\" (UniqueName: \"kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-kube-api-access-vbrh2\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.865247 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.865194    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-certs\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.865247 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.865243    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-token\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.865384 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.865271    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-envoy\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.865384 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.865295    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-credential-socket\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.865384 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.865345    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-data\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.865499 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.865439    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-podinfo\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.865499 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.865476    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istiod-ca-cert\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.966810 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.966776    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-podinfo\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.967009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.966826    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istiod-ca-cert\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.967009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.966941    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-socket\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.967009 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.966979    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbrh2\" (UniqueName: \"kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-kube-api-access-vbrh2\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.967209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.967048    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-certs\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.967209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.967097    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-token\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.967209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.967141    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-envoy\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.967209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.967179    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-credential-socket\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.967209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.967207    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-data\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.967496 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.967463    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-certs\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.967636 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.967614    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-socket\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.967754 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.967733    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-data\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.967891 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.967835    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-credential-socket\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.968107 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.968087    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istiod-ca-cert\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.969411 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.969389    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-envoy\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.969496 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.969394    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-podinfo\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.979631 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.979604    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-token\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:21.979725 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:21.979709    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbrh2\" (UniqueName: \"kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-kube-api-access-vbrh2\") pod \"e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") " pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:22.077744 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.077710    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:22.358475 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.358448    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"]
Oct 30 21:21:22.360747 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:21:22.360721    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1292ca_bd9b_4f90_a191_f848b35bfeb9.slice/crio-c2405c02d1cecf944100c8f86d091d5efbffc6b564c0ed6c105af628d717ae9e WatchSource:0}: Error finding container c2405c02d1cecf944100c8f86d091d5efbffc6b564c0ed6c105af628d717ae9e: Status 404 returned error can't find the container with id c2405c02d1cecf944100c8f86d091d5efbffc6b564c0ed6c105af628d717ae9e
Oct 30 21:21:22.362857 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.362829    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:21:22.362942 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.362890    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:21:22.362942 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.362919    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:21:22.503913 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.503869    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"]
Oct 30 21:21:22.507916 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.507891    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.522395 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.522364    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"]
Oct 30 21:21:22.673145 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.673058    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7557a5bb-f8b7-4161-8d7f-d874b570b382-maas-api-tls\") pod \"maas-api-5d4dc8d99b-f4bxl\" (UID: \"7557a5bb-f8b7-4161-8d7f-d874b570b382\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.673314 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.673171    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7557a5bb-f8b7-4161-8d7f-d874b570b382-metrics-certs\") pod \"maas-api-5d4dc8d99b-f4bxl\" (UID: \"7557a5bb-f8b7-4161-8d7f-d874b570b382\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.673314 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.673278    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47nd5\" (UniqueName: \"kubernetes.io/projected/7557a5bb-f8b7-4161-8d7f-d874b570b382-kube-api-access-47nd5\") pod \"maas-api-5d4dc8d99b-f4bxl\" (UID: \"7557a5bb-f8b7-4161-8d7f-d874b570b382\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.673314 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.673305    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7557a5bb-f8b7-4161-8d7f-d874b570b382-openshift-service-ca\") pod \"maas-api-5d4dc8d99b-f4bxl\" (UID: \"7557a5bb-f8b7-4161-8d7f-d874b570b382\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.773878 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.773834    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47nd5\" (UniqueName: \"kubernetes.io/projected/7557a5bb-f8b7-4161-8d7f-d874b570b382-kube-api-access-47nd5\") pod \"maas-api-5d4dc8d99b-f4bxl\" (UID: \"7557a5bb-f8b7-4161-8d7f-d874b570b382\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.773878 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.773883    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7557a5bb-f8b7-4161-8d7f-d874b570b382-openshift-service-ca\") pod \"maas-api-5d4dc8d99b-f4bxl\" (UID: \"7557a5bb-f8b7-4161-8d7f-d874b570b382\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.774470 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.773938    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7557a5bb-f8b7-4161-8d7f-d874b570b382-maas-api-tls\") pod \"maas-api-5d4dc8d99b-f4bxl\" (UID: \"7557a5bb-f8b7-4161-8d7f-d874b570b382\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.774470 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.774077    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7557a5bb-f8b7-4161-8d7f-d874b570b382-metrics-certs\") pod \"maas-api-5d4dc8d99b-f4bxl\" (UID: \"7557a5bb-f8b7-4161-8d7f-d874b570b382\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.774703 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.774682    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7557a5bb-f8b7-4161-8d7f-d874b570b382-openshift-service-ca\") pod \"maas-api-5d4dc8d99b-f4bxl\" (UID: \"7557a5bb-f8b7-4161-8d7f-d874b570b382\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.776457 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.776434    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7557a5bb-f8b7-4161-8d7f-d874b570b382-metrics-certs\") pod \"maas-api-5d4dc8d99b-f4bxl\" (UID: \"7557a5bb-f8b7-4161-8d7f-d874b570b382\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.776571 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.776528    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7557a5bb-f8b7-4161-8d7f-d874b570b382-maas-api-tls\") pod \"maas-api-5d4dc8d99b-f4bxl\" (UID: \"7557a5bb-f8b7-4161-8d7f-d874b570b382\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.786496 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.786474    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47nd5\" (UniqueName: \"kubernetes.io/projected/7557a5bb-f8b7-4161-8d7f-d874b570b382-kube-api-access-47nd5\") pod \"maas-api-5d4dc8d99b-f4bxl\" (UID: \"7557a5bb-f8b7-4161-8d7f-d874b570b382\") " pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.832975 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.832946    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:22.850858 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.850815    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" event={"ID":"fa1292ca-bd9b-4f90-a191-f848b35bfeb9","Type":"ContainerStarted","Data":"322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b"}
Oct 30 21:21:22.850979 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.850906    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" event={"ID":"fa1292ca-bd9b-4f90-a191-f848b35bfeb9","Type":"ContainerStarted","Data":"c2405c02d1cecf944100c8f86d091d5efbffc6b564c0ed6c105af628d717ae9e"}
Oct 30 21:21:22.900860 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:22.900811    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" podStartSLOduration=1.900797377 podStartE2EDuration="1.900797377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:22.899396571 +0000 UTC m=+2493.758132869" watchObservedRunningTime="2026-10-30 21:21:22.900797377 +0000 UTC m=+2493.759533671"
Oct 30 21:21:23.078316 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:23.078284    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:23.083106 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:23.083081    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:23.111400 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:23.111338    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"]
Oct 30 21:21:23.113743 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:21:23.113714    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7557a5bb_f8b7_4161_8d7f_d874b570b382.slice/crio-25393018d445c1e5e6810f134d405e03c0ff1a5232108ca88f1138d018614546 WatchSource:0}: Error finding container 25393018d445c1e5e6810f134d405e03c0ff1a5232108ca88f1138d018614546: Status 404 returned error can't find the container with id 25393018d445c1e5e6810f134d405e03c0ff1a5232108ca88f1138d018614546
Oct 30 21:21:23.857597 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:23.857501    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl" event={"ID":"7557a5bb-f8b7-4161-8d7f-d874b570b382","Type":"ContainerStarted","Data":"42a4538db323db4694f40b9a4eeb60e6d0b6a4322491b19b56f252c3cecb9d4d"}
Oct 30 21:21:23.857597 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:23.857563    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl" event={"ID":"7557a5bb-f8b7-4161-8d7f-d874b570b382","Type":"ContainerStarted","Data":"25393018d445c1e5e6810f134d405e03c0ff1a5232108ca88f1138d018614546"}
Oct 30 21:21:23.858047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:23.857758    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:23.858047 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:23.857834    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:23.858715 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:23.858699    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:23.879710 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:23.879657    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl" podStartSLOduration=1.437462137 podStartE2EDuration="1.879642099s" totalImagesPullingTime="442.179962ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:23.878357046 +0000 UTC m=+2494.737093340" watchObservedRunningTime="2026-10-30 21:21:23.879642099 +0000 UTC m=+2494.738378371"
Oct 30 21:21:29.868038 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:29.867994    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5d4dc8d99b-f4bxl"
Oct 30 21:21:29.925520 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:29.925476    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6797b9d996-bd495"]
Oct 30 21:21:29.934006 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:29.925737    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495" podUID="ee4819aa-b074-4aa5-a253-f50e935704d0" containerName="maas-api" containerID="cri-o://d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394" gracePeriod=30
Oct 30 21:21:30.226442 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.226170    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:30.373858 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.373767    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-metrics-certs\") pod \"ee4819aa-b074-4aa5-a253-f50e935704d0\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") "
Oct 30 21:21:30.373858 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.373851    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee4819aa-b074-4aa5-a253-f50e935704d0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4819aa-b074-4aa5-a253-f50e935704d0-openshift-service-ca\") pod \"ee4819aa-b074-4aa5-a253-f50e935704d0\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") "
Oct 30 21:21:30.374123 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.373893    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-maas-api-tls\") pod \"ee4819aa-b074-4aa5-a253-f50e935704d0\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") "
Oct 30 21:21:30.374123 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.373956    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee4819aa-b074-4aa5-a253-f50e935704d0-kube-api-access-bt5w6\" (UniqueName: \"kubernetes.io/projected/ee4819aa-b074-4aa5-a253-f50e935704d0-kube-api-access-bt5w6\") pod \"ee4819aa-b074-4aa5-a253-f50e935704d0\" (UID: \"ee4819aa-b074-4aa5-a253-f50e935704d0\") "
Oct 30 21:21:30.374259 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.374233    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee4819aa-b074-4aa5-a253-f50e935704d0-openshift-service-ca" pod "ee4819aa-b074-4aa5-a253-f50e935704d0" (UID: "ee4819aa-b074-4aa5-a253-f50e935704d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:21:30.374399 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.374377    6048 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4819aa-b074-4aa5-a253-f50e935704d0-openshift-service-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.376115 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.376093    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-metrics-certs" pod "ee4819aa-b074-4aa5-a253-f50e935704d0" (UID: "ee4819aa-b074-4aa5-a253-f50e935704d0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:21:30.376596 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.376570    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-maas-api-tls" pod "ee4819aa-b074-4aa5-a253-f50e935704d0" (UID: "ee4819aa-b074-4aa5-a253-f50e935704d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:21:30.376666 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.376578    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee4819aa-b074-4aa5-a253-f50e935704d0-kube-api-access-bt5w6" pod "ee4819aa-b074-4aa5-a253-f50e935704d0" (UID: "ee4819aa-b074-4aa5-a253-f50e935704d0"). InnerVolumeSpecName "kube-api-access-bt5w6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:30.475001 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.474963    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt5w6\" (UniqueName: \"kubernetes.io/projected/ee4819aa-b074-4aa5-a253-f50e935704d0-kube-api-access-bt5w6\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.475001 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.474995    6048 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-metrics-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.475001 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.475006    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee4819aa-b074-4aa5-a253-f50e935704d0-maas-api-tls\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.897406 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.897373    6048 generic.go:356] "Generic (PLEG): container finished" podID="ee4819aa-b074-4aa5-a253-f50e935704d0" containerID="d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394" exitCode=0
Oct 30 21:21:30.897855 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.897415    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495"
Oct 30 21:21:30.897855 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.897455    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495" event={"ID":"ee4819aa-b074-4aa5-a253-f50e935704d0","Type":"ContainerDied","Data":"d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394"}
Oct 30 21:21:30.897855 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.897522    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6797b9d996-bd495" event={"ID":"ee4819aa-b074-4aa5-a253-f50e935704d0","Type":"ContainerDied","Data":"fe2d82b5ca8b44a28bf115b113c1e8a4c89d75012deaaf9b79efaab5de53517d"}
Oct 30 21:21:30.897855 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.897551    6048 scope.go:122] "RemoveContainer" containerID="d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394"
Oct 30 21:21:30.907178 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.907156    6048 scope.go:122] "RemoveContainer" containerID="d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394"
Oct 30 21:21:30.907459 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:21:30.907442    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394\": container with ID starting with d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394 not found: ID does not exist" containerID="d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394"
Oct 30 21:21:30.907505 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.907468    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394"} err="failed to get container status \"d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394\": rpc error: code = NotFound desc = could not find container \"d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394\": container with ID starting with d85425c114b67b87614afb3350e76edad1b81832135672f1870765a162214394 not found: ID does not exist"
Oct 30 21:21:30.919700 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.919673    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6797b9d996-bd495"]
Oct 30 21:21:30.923546 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:30.923524    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6797b9d996-bd495"]
Oct 30 21:21:31.270649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:31.270567    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee4819aa-b074-4aa5-a253-f50e935704d0" path="/var/lib/kubelet/pods/ee4819aa-b074-4aa5-a253-f50e935704d0/volumes"
Oct 30 21:21:38.859863 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:38.859775    6048 patch_prober.go:29] interesting pod/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 21:21:38.859863 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:38.859847    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 21:21:38.943279 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:38.943241    6048 generic.go:356] "Generic (PLEG): container finished" podID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerID="322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b" exitCode=0
Oct 30 21:21:38.943458 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:38.943313    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" event={"ID":"fa1292ca-bd9b-4f90-a191-f848b35bfeb9","Type":"ContainerDied","Data":"322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b"}
Oct 30 21:21:38.943722 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:38.943703    6048 scope.go:122] "RemoveContainer" containerID="322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b"
Oct 30 21:21:38.951967 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:38.945394    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:21:38.951967 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:38.945561    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:21:38.951967 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:38.945659    6048 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:21:39.972644 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:39.972601    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" event={"ID":"fa1292ca-bd9b-4f90-a191-f848b35bfeb9","Type":"ContainerStarted","Data":"4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08"}
Oct 30 21:21:40.078070 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:40.078031    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:40.078303 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:40.078282    6048 patch_prober.go:29] interesting pod/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 21:21:40.078349 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:40.078328    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 21:21:41.078929 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:41.078890    6048 patch_prober.go:29] interesting pod/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 21:21:41.079351 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:41.078942    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 21:21:42.078229 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:42.078196    6048 patch_prober.go:29] interesting pod/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 21:21:42.078409 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:42.078254    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 21:21:43.078077 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:43.078012    6048 patch_prober.go:29] interesting pod/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 21:21:43.078469 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:43.078096    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 21:21:44.078541 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:44.078503    6048 patch_prober.go:29] interesting pod/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused" start-of-body=
Oct 30 21:21:44.078960 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:44.078564    6048 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.132:15021/healthz/ready\": dial tcp 10.134.0.132:15021: connect: connection refused"
Oct 30 21:21:45.082617 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:45.082585    6048 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:45.083016 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:45.082977    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:45.083802 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:45.083783    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:21:46.801423 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:21:46.801376    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:21:51.215276 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:51.215241    6048 scope.go:122] "RemoveContainer" containerID="d2589beefbe25fc7987413b4f95b8921a4efb343e7c7e092838545ec54a3d36f"
Oct 30 21:21:56.674504 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:56.674466    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"]
Oct 30 21:21:56.675118 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:21:56.674732    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy" containerID="cri-o://4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08" gracePeriod=30
Oct 30 21:22:00.085624 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:00.085544    6048 patch_prober.go:29] interesting pod/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:22:00.085624 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:00.085613    6048 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:22:01.930077 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:01.930000    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:22:02.088233 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.088204    6048 generic.go:356] "Generic (PLEG): container finished" podID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerID="4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08" exitCode=0
Oct 30 21:22:02.088404 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.088257    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"
Oct 30 21:22:02.088404 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.088292    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" event={"ID":"fa1292ca-bd9b-4f90-a191-f848b35bfeb9","Type":"ContainerDied","Data":"4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08"}
Oct 30 21:22:02.088404 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.088347    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl" event={"ID":"fa1292ca-bd9b-4f90-a191-f848b35bfeb9","Type":"ContainerDied","Data":"c2405c02d1cecf944100c8f86d091d5efbffc6b564c0ed6c105af628d717ae9e"}
Oct 30 21:22:02.088404 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.088368    6048 scope.go:122] "RemoveContainer" containerID="4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08"
Oct 30 21:22:02.097161 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.097142    6048 scope.go:122] "RemoveContainer" containerID="322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b"
Oct 30 21:22:02.105355 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.105336    6048 scope.go:122] "RemoveContainer" containerID="4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08"
Oct 30 21:22:02.105611 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:22:02.105593    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08\": container with ID starting with 4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08 not found: ID does not exist" containerID="4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08"
Oct 30 21:22:02.105658 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.105620    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08"} err="failed to get container status \"4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08\": rpc error: code = NotFound desc = could not find container \"4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08\": container with ID starting with 4943aa66e4ab44333ab23b76697529ccebcb5ab56023fcbb7fa6aa07d7451f08 not found: ID does not exist"
Oct 30 21:22:02.105658 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.105637    6048 scope.go:122] "RemoveContainer" containerID="322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b"
Oct 30 21:22:02.105887 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:22:02.105867    6048 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b\": container with ID starting with 322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b not found: ID does not exist" containerID="322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b"
Oct 30 21:22:02.105931 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.105893    6048 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b"} err="failed to get container status \"322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b\": rpc error: code = NotFound desc = could not find container \"322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b\": container with ID starting with 322da219f271db694ebef636fd3960873875aa188c783351e61326821b4edc1b not found: ID does not exist"
Oct 30 21:22:02.114207 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114189    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-data\") pod \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") "
Oct 30 21:22:02.114271 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114247    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-envoy\") pod \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") "
Oct 30 21:22:02.114340 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114325    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-certs\") pod \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") "
Oct 30 21:22:02.114398 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114382    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-credential-socket\") pod \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") "
Oct 30 21:22:02.114445 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114416    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-data" pod "fa1292ca-bd9b-4f90-a191-f848b35bfeb9" (UID: "fa1292ca-bd9b-4f90-a191-f848b35bfeb9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:22:02.114445 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114419    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-token\" (UniqueName: \"kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-token\") pod \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") "
Oct 30 21:22:02.114549 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114500    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-kube-api-access-vbrh2\" (UniqueName: \"kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-kube-api-access-vbrh2\") pod \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") "
Oct 30 21:22:02.114549 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114539    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istiod-ca-cert\") pod \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") "
Oct 30 21:22:02.114664 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114581    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-socket\") pod \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") "
Oct 30 21:22:02.114664 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114600    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-podinfo\") pod \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\" (UID: \"fa1292ca-bd9b-4f90-a191-f848b35bfeb9\") "
Oct 30 21:22:02.114785 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114573    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-certs" pod "fa1292ca-bd9b-4f90-a191-f848b35bfeb9" (UID: "fa1292ca-bd9b-4f90-a191-f848b35bfeb9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:22:02.114785 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114701    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-credential-socket" pod "fa1292ca-bd9b-4f90-a191-f848b35bfeb9" (UID: "fa1292ca-bd9b-4f90-a191-f848b35bfeb9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:22:02.114894 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114810    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-socket" pod "fa1292ca-bd9b-4f90-a191-f848b35bfeb9" (UID: "fa1292ca-bd9b-4f90-a191-f848b35bfeb9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:22:02.114953 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.114910    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istiod-ca-cert" pod "fa1292ca-bd9b-4f90-a191-f848b35bfeb9" (UID: "fa1292ca-bd9b-4f90-a191-f848b35bfeb9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:22:02.115087 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.115063    6048 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-data\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:22:02.115248 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.115227    6048 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:22:02.115324 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.115253    6048 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-credential-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:22:02.115324 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.115269    6048 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istiod-ca-cert\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:22:02.115324 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.115284    6048 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-workload-socket\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:22:02.116690 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.116665    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-podinfo" pod "fa1292ca-bd9b-4f90-a191-f848b35bfeb9" (UID: "fa1292ca-bd9b-4f90-a191-f848b35bfeb9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:22:02.116783 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.116658    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-kube-api-access-vbrh2" pod "fa1292ca-bd9b-4f90-a191-f848b35bfeb9" (UID: "fa1292ca-bd9b-4f90-a191-f848b35bfeb9"). InnerVolumeSpecName "kube-api-access-vbrh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:22:02.116846 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.116817    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-envoy" pod "fa1292ca-bd9b-4f90-a191-f848b35bfeb9" (UID: "fa1292ca-bd9b-4f90-a191-f848b35bfeb9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:22:02.116928 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.116881    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-token" pod "fa1292ca-bd9b-4f90-a191-f848b35bfeb9" (UID: "fa1292ca-bd9b-4f90-a191-f848b35bfeb9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:22:02.216650 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.216617    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbrh2\" (UniqueName: \"kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-kube-api-access-vbrh2\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:22:02.216650 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.216645    6048 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-podinfo\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:22:02.216650 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.216658    6048 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-envoy\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:22:02.216864 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.216668    6048 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa1292ca-bd9b-4f90-a191-f848b35bfeb9-istio-token\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:22:02.417582 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.417549    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"]
Oct 30 21:22:02.433656 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:02.433625    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-68a46da4-openshift-default-8658ff6769-c9vbl"]
Oct 30 21:22:03.133831 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.133796    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"]
Oct 30 21:22:03.134737 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.134713    6048 cpu_manager.go:414] "containerMap: removing container" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy"
Oct 30 21:22:03.134737 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.134735    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy"
Oct 30 21:22:03.134941 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.134768    6048 cpu_manager.go:414] "containerMap: removing container" podUID="ee4819aa-b074-4aa5-a253-f50e935704d0" containerName="maas-api"
Oct 30 21:22:03.134941 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.134775    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee4819aa-b074-4aa5-a253-f50e935704d0" containerName="maas-api"
Oct 30 21:22:03.134941 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.134855    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee4819aa-b074-4aa5-a253-f50e935704d0" containerName="maas-api"
Oct 30 21:22:03.134941 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.134875    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy"
Oct 30 21:22:03.139676 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.139656    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.155501 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.155469    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"]
Oct 30 21:22:03.171844 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.171814    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-d8974d-serving-cert\""
Oct 30 21:22:03.257983 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.257952    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" path="/var/lib/kubelet/pods/fa1292ca-bd9b-4f90-a191-f848b35bfeb9/volumes"
Oct 30 21:22:03.276476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.276444    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"]
Oct 30 21:22:03.276977 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.276958    6048 cpu_manager.go:414] "containerMap: removing container" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy"
Oct 30 21:22:03.277096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.276979    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy"
Oct 30 21:22:03.277163 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.277141    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa1292ca-bd9b-4f90-a191-f848b35bfeb9" containerName="istio-proxy"
Oct 30 21:22:03.280424 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.280405    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"
Oct 30 21:22:03.290422 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.290041    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-authcfg-http-d8974d\""
Oct 30 21:22:03.291277 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.291235    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-authcfg-http-d8974d-dockercfg-lp4t8\""
Oct 30 21:22:03.292782 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.292762    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"]
Oct 30 21:22:03.320884 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.320846    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"]
Oct 30 21:22:03.325419 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.325399    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"
Oct 30 21:22:03.328067 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.328040    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.328182 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.328082    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.328182 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.328101    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7jxf\" (UniqueName: \"kubernetes.io/projected/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-kube-api-access-f7jxf\") pod \"maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.328182 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.328127    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-metrics-certs\") pod \"maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.339921 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.339891    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"]
Oct 30 21:22:03.430120 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.429959    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn5hw\" (UniqueName: \"kubernetes.io/projected/142f02fd-f2eb-46f7-b0bf-38061aa756df-kube-api-access-mn5hw\") pod \"payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x\" (UID: \"142f02fd-f2eb-46f7-b0bf-38061aa756df\") " pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"
Oct 30 21:22:03.430120 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.430110    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.430476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.430166    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.430476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.430204    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7jxf\" (UniqueName: \"kubernetes.io/projected/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-kube-api-access-f7jxf\") pod \"maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.430476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.430242    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-metrics-certs\") pod \"maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.430476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.430285    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-plugins-config-volume\") pod \"payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv\" (UID: \"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06\") " pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"
Oct 30 21:22:03.430476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.430359    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/142f02fd-f2eb-46f7-b0bf-38061aa756df-plugins-config-volume\") pod \"payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x\" (UID: \"142f02fd-f2eb-46f7-b0bf-38061aa756df\") " pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"
Oct 30 21:22:03.430476 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.430397    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb77d\" (UniqueName: \"kubernetes.io/projected/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-kube-api-access-gb77d\") pod \"payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv\" (UID: \"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06\") " pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"
Oct 30 21:22:03.432257 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.432231    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.433710 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.433686    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-metrics-certs\") pod \"maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.434338 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.434318    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.456446 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.456420    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7jxf\" (UniqueName: \"kubernetes.io/projected/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-kube-api-access-f7jxf\") pod \"maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.458231 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.458215    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:03.532096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.531827    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn5hw\" (UniqueName: \"kubernetes.io/projected/142f02fd-f2eb-46f7-b0bf-38061aa756df-kube-api-access-mn5hw\") pod \"payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x\" (UID: \"142f02fd-f2eb-46f7-b0bf-38061aa756df\") " pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"
Oct 30 21:22:03.532096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.531911    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-plugins-config-volume\") pod \"payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv\" (UID: \"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06\") " pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"
Oct 30 21:22:03.532096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.531951    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/142f02fd-f2eb-46f7-b0bf-38061aa756df-plugins-config-volume\") pod \"payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x\" (UID: \"142f02fd-f2eb-46f7-b0bf-38061aa756df\") " pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"
Oct 30 21:22:03.532096 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.531972    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb77d\" (UniqueName: \"kubernetes.io/projected/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-kube-api-access-gb77d\") pod \"payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv\" (UID: \"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06\") " pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"
Oct 30 21:22:03.532800 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.532770    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-plugins-config-volume\") pod \"payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv\" (UID: \"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06\") " pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"
Oct 30 21:22:03.533233 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.533211    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/142f02fd-f2eb-46f7-b0bf-38061aa756df-plugins-config-volume\") pod \"payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x\" (UID: \"142f02fd-f2eb-46f7-b0bf-38061aa756df\") " pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"
Oct 30 21:22:03.551055 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.550985    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb77d\" (UniqueName: \"kubernetes.io/projected/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-kube-api-access-gb77d\") pod \"payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv\" (UID: \"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06\") " pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"
Oct 30 21:22:03.551570 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.551547    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn5hw\" (UniqueName: \"kubernetes.io/projected/142f02fd-f2eb-46f7-b0bf-38061aa756df-kube-api-access-mn5hw\") pod \"payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x\" (UID: \"142f02fd-f2eb-46f7-b0bf-38061aa756df\") " pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"
Oct 30 21:22:03.594457 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.594422    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"
Oct 30 21:22:03.638661 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.638411    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"
Oct 30 21:22:03.750764 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.750722    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"]
Oct 30 21:22:03.886610 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.886558    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"]
Oct 30 21:22:03.888278 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:22:03.888251    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod142f02fd_f2eb_46f7_b0bf_38061aa756df.slice/crio-d36515db5774dccf13159b4d6044394a2030f643405bc34ed0c1206c7f7316ea WatchSource:0}: Error finding container d36515db5774dccf13159b4d6044394a2030f643405bc34ed0c1206c7f7316ea: Status 404 returned error can't find the container with id d36515db5774dccf13159b4d6044394a2030f643405bc34ed0c1206c7f7316ea
Oct 30 21:22:03.941713 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:03.941690    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"]
Oct 30 21:22:03.944250 ip-10-0-131-162 kubenswrapper[6048]: W1030 21:22:03.944224    6048 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad2abb5_3bc8_4ce8_8d00_2a7ddf72de06.slice/crio-7f1811c5416c3e2b54b5dfdee8ad3f93538e61a1b0573776bd151671eb03ae16 WatchSource:0}: Error finding container 7f1811c5416c3e2b54b5dfdee8ad3f93538e61a1b0573776bd151671eb03ae16: Status 404 returned error can't find the container with id 7f1811c5416c3e2b54b5dfdee8ad3f93538e61a1b0573776bd151671eb03ae16
Oct 30 21:22:04.100674 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:04.100638    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px" event={"ID":"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0","Type":"ContainerStarted","Data":"fe634cdb370208108bc9e490b5b5421b7472656ad425e07f0936f057a4b31f55"}
Oct 30 21:22:04.102142 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:04.102117    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv" event={"ID":"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06","Type":"ContainerStarted","Data":"1e7801e872e2dd48173ac7104abb5052af0f5686c12a2cd4cf4652c155da8d3c"}
Oct 30 21:22:04.102289 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:04.102158    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv" event={"ID":"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06","Type":"ContainerStarted","Data":"7f1811c5416c3e2b54b5dfdee8ad3f93538e61a1b0573776bd151671eb03ae16"}
Oct 30 21:22:04.102289 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:04.102254    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"
Oct 30 21:22:04.103610 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:04.103588    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x" event={"ID":"142f02fd-f2eb-46f7-b0bf-38061aa756df","Type":"ContainerStarted","Data":"3df5ed2f360ff5e77f41fa5b1a4947d1b1128e6c28a2299be19ac45e31606fdf"}
Oct 30 21:22:04.103733 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:04.103619    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x" event={"ID":"142f02fd-f2eb-46f7-b0bf-38061aa756df","Type":"ContainerStarted","Data":"d36515db5774dccf13159b4d6044394a2030f643405bc34ed0c1206c7f7316ea"}
Oct 30 21:22:04.103733 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:04.103711    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"
Oct 30 21:22:04.122070 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:04.122014    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv" podStartSLOduration=1.122000982 podStartE2EDuration="1.122000982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:04.120262062 +0000 UTC m=+2534.978998354" watchObservedRunningTime="2026-10-30 21:22:04.122000982 +0000 UTC m=+2534.980737276"
Oct 30 21:22:04.140508 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:04.140445    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x" podStartSLOduration=1.140429865 podStartE2EDuration="1.140429865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:04.139264851 +0000 UTC m=+2534.998001149" watchObservedRunningTime="2026-10-30 21:22:04.140429865 +0000 UTC m=+2534.999166159"
Oct 30 21:22:05.110038 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:05.109978    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px" event={"ID":"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0","Type":"ContainerStarted","Data":"795f9bdd7cc465c6dfe53ace0225385b9a409aee597ce2e5b6c2f8b0ca88815a"}
Oct 30 21:22:05.110284 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:05.110265    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:05.131919 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:05.131867    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px" podStartSLOduration=1.382037325 podStartE2EDuration="2.131853393s" totalImagesPullingTime="749.816068ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:05.130331849 +0000 UTC m=+2535.989068145" watchObservedRunningTime="2026-10-30 21:22:05.131853393 +0000 UTC m=+2535.990589686"
Oct 30 21:22:11.120897 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:11.120861    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:22:15.113085 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:15.113054    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"
Oct 30 21:22:15.113487 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:22:15.113124    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"
Oct 30 21:22:16.804738 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:22:16.804700    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:22:46.801483 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:22:46.801442    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:23:05.021611 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:05.021576    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"]
Oct 30 21:23:05.024039 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:05.024001    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d576e68b-vmjh5"]
Oct 30 21:23:05.258311 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:05.258275    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="19e8b589-40bc-439a-80c5-911238a83b42" path="/var/lib/kubelet/pods/19e8b589-40bc-439a-80c5-911238a83b42/volumes"
Oct 30 21:23:16.801426 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:23:16.801388    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:23:24.023962 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:24.023925    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"]
Oct 30 21:23:24.029757 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:24.029727    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d2bc93bc-9dnxz"]
Oct 30 21:23:25.257601 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:25.257563    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="91b4f100-1b89-408f-a19f-56ec3a63ec9f" path="/var/lib/kubelet/pods/91b4f100-1b89-408f-a19f-56ec3a63ec9f/volumes"
Oct 30 21:23:46.803216 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:23:46.803119    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:23:49.486043 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:49.485987    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"]
Oct 30 21:23:49.498224 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:49.498190    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"]
Oct 30 21:23:54.486366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.486300    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv" podUID="0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06" containerName="payload-processing" containerID="cri-o://1e7801e872e2dd48173ac7104abb5052af0f5686c12a2cd4cf4652c155da8d3c" gracePeriod=25
Oct 30 21:23:54.499633 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.499576    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x" podUID="142f02fd-f2eb-46f7-b0bf-38061aa756df" containerName="payload-pre-processing" containerID="cri-o://3df5ed2f360ff5e77f41fa5b1a4947d1b1128e6c28a2299be19ac45e31606fdf" gracePeriod=25
Oct 30 21:23:54.699001 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.698959    6048 generic.go:356] "Generic (PLEG): container finished" podID="0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06" containerID="1e7801e872e2dd48173ac7104abb5052af0f5686c12a2cd4cf4652c155da8d3c" exitCode=0
Oct 30 21:23:54.699213 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.699108    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv" event={"ID":"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06","Type":"ContainerDied","Data":"1e7801e872e2dd48173ac7104abb5052af0f5686c12a2cd4cf4652c155da8d3c"}
Oct 30 21:23:54.701220 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.701190    6048 generic.go:356] "Generic (PLEG): container finished" podID="142f02fd-f2eb-46f7-b0bf-38061aa756df" containerID="3df5ed2f360ff5e77f41fa5b1a4947d1b1128e6c28a2299be19ac45e31606fdf" exitCode=0
Oct 30 21:23:54.701378 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.701255    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x" event={"ID":"142f02fd-f2eb-46f7-b0bf-38061aa756df","Type":"ContainerDied","Data":"3df5ed2f360ff5e77f41fa5b1a4947d1b1128e6c28a2299be19ac45e31606fdf"}
Oct 30 21:23:54.762462 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.762436    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"
Oct 30 21:23:54.785412 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.785380    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"
Oct 30 21:23:54.863194 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.863159    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/142f02fd-f2eb-46f7-b0bf-38061aa756df-kube-api-access-mn5hw\" (UniqueName: \"kubernetes.io/projected/142f02fd-f2eb-46f7-b0bf-38061aa756df-kube-api-access-mn5hw\") pod \"142f02fd-f2eb-46f7-b0bf-38061aa756df\" (UID: \"142f02fd-f2eb-46f7-b0bf-38061aa756df\") "
Oct 30 21:23:54.863392 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.863252    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-plugins-config-volume\") pod \"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06\" (UID: \"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06\") "
Oct 30 21:23:54.863392 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.863294    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-kube-api-access-gb77d\" (UniqueName: \"kubernetes.io/projected/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-kube-api-access-gb77d\") pod \"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06\" (UID: \"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06\") "
Oct 30 21:23:54.863392 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.863352    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/142f02fd-f2eb-46f7-b0bf-38061aa756df-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/142f02fd-f2eb-46f7-b0bf-38061aa756df-plugins-config-volume\") pod \"142f02fd-f2eb-46f7-b0bf-38061aa756df\" (UID: \"142f02fd-f2eb-46f7-b0bf-38061aa756df\") "
Oct 30 21:23:54.863661 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.863601    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-plugins-config-volume" pod "0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06" (UID: "0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:54.863855 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.863833    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/142f02fd-f2eb-46f7-b0bf-38061aa756df-plugins-config-volume" pod "142f02fd-f2eb-46f7-b0bf-38061aa756df" (UID: "142f02fd-f2eb-46f7-b0bf-38061aa756df"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:54.865301 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.865274    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/142f02fd-f2eb-46f7-b0bf-38061aa756df-kube-api-access-mn5hw" pod "142f02fd-f2eb-46f7-b0bf-38061aa756df" (UID: "142f02fd-f2eb-46f7-b0bf-38061aa756df"). InnerVolumeSpecName "kube-api-access-mn5hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:54.865422 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.865353    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-kube-api-access-gb77d" pod "0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06" (UID: "0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06"). InnerVolumeSpecName "kube-api-access-gb77d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:54.964164 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.964115    6048 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/142f02fd-f2eb-46f7-b0bf-38061aa756df-plugins-config-volume\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:23:54.964164 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.964156    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn5hw\" (UniqueName: \"kubernetes.io/projected/142f02fd-f2eb-46f7-b0bf-38061aa756df-kube-api-access-mn5hw\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:23:54.964164 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.964167    6048 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-plugins-config-volume\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:23:54.964164 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:54.964176    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb77d\" (UniqueName: \"kubernetes.io/projected/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06-kube-api-access-gb77d\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:23:55.518372 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.518280    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"]
Oct 30 21:23:55.518824 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.518531    6048 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px" podUID="b1bf0ea1-0290-4e3b-8594-3bb1afb659e0" containerName="maas-api" containerID="cri-o://795f9bdd7cc465c6dfe53ace0225385b9a409aee597ce2e5b6c2f8b0ca88815a" gracePeriod=30
Oct 30 21:23:55.709708 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.709667    6048 generic.go:356] "Generic (PLEG): container finished" podID="b1bf0ea1-0290-4e3b-8594-3bb1afb659e0" containerID="795f9bdd7cc465c6dfe53ace0225385b9a409aee597ce2e5b6c2f8b0ca88815a" exitCode=0
Oct 30 21:23:55.709929 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.709743    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px" event={"ID":"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0","Type":"ContainerDied","Data":"795f9bdd7cc465c6dfe53ace0225385b9a409aee597ce2e5b6c2f8b0ca88815a"}
Oct 30 21:23:55.711758 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.711721    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"
Oct 30 21:23:55.712269 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.711741    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv" event={"ID":"0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06","Type":"ContainerDied","Data":"7f1811c5416c3e2b54b5dfdee8ad3f93538e61a1b0573776bd151671eb03ae16"}
Oct 30 21:23:55.712592 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.712515    6048 scope.go:122] "RemoveContainer" containerID="1e7801e872e2dd48173ac7104abb5052af0f5686c12a2cd4cf4652c155da8d3c"
Oct 30 21:23:55.716665 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.716616    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x" event={"ID":"142f02fd-f2eb-46f7-b0bf-38061aa756df","Type":"ContainerDied","Data":"d36515db5774dccf13159b4d6044394a2030f643405bc34ed0c1206c7f7316ea"}
Oct 30 21:23:55.716787 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.716648    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"
Oct 30 21:23:55.738193 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.732787    6048 scope.go:122] "RemoveContainer" containerID="3df5ed2f360ff5e77f41fa5b1a4947d1b1128e6c28a2299be19ac45e31606fdf"
Oct 30 21:23:55.747078 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.746413    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"]
Oct 30 21:23:55.749093 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.749062    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-authcfg-http-d8974d-774d748-lnmmv"]
Oct 30 21:23:55.756441 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.756414    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"]
Oct 30 21:23:55.760934 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.760912    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-authcfg-http-d8974d-66d75cd6f5-spc5x"]
Oct 30 21:23:55.783947 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.783892    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:23:55.873717 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.873688    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-openshift-service-ca\") pod \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") "
Oct 30 21:23:55.873887 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.873753    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-maas-api-tls\") pod \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") "
Oct 30 21:23:55.873887 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.873779    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-kube-api-access-f7jxf\" (UniqueName: \"kubernetes.io/projected/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-kube-api-access-f7jxf\") pod \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") "
Oct 30 21:23:55.873887 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.873802    6048 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-metrics-certs\") pod \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\" (UID: \"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0\") "
Oct 30 21:23:55.874137 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.874109    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-openshift-service-ca" pod "b1bf0ea1-0290-4e3b-8594-3bb1afb659e0" (UID: "b1bf0ea1-0290-4e3b-8594-3bb1afb659e0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:55.875949 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.875923    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-maas-api-tls" pod "b1bf0ea1-0290-4e3b-8594-3bb1afb659e0" (UID: "b1bf0ea1-0290-4e3b-8594-3bb1afb659e0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:23:55.876049 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.876036    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-metrics-certs" pod "b1bf0ea1-0290-4e3b-8594-3bb1afb659e0" (UID: "b1bf0ea1-0290-4e3b-8594-3bb1afb659e0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:23:55.876099 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.876015    6048 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-kube-api-access-f7jxf" pod "b1bf0ea1-0290-4e3b-8594-3bb1afb659e0" (UID: "b1bf0ea1-0290-4e3b-8594-3bb1afb659e0"). InnerVolumeSpecName "kube-api-access-f7jxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:55.975436 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.975400    6048 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-openshift-service-ca\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:23:55.975436 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.975429    6048 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-maas-api-tls\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:23:55.975436 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.975438    6048 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7jxf\" (UniqueName: \"kubernetes.io/projected/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-kube-api-access-f7jxf\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:23:55.975665 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:55.975447    6048 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0-metrics-certs\") on node \"ip-10-0-131-162.us-east-2.compute.internal\" DevicePath \"\""
Oct 30 21:23:56.723462 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:56.723430    6048 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"
Oct 30 21:23:56.723928 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:56.723455    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px" event={"ID":"b1bf0ea1-0290-4e3b-8594-3bb1afb659e0","Type":"ContainerDied","Data":"fe634cdb370208108bc9e490b5b5421b7472656ad425e07f0936f057a4b31f55"}
Oct 30 21:23:56.723928 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:56.723525    6048 scope.go:122] "RemoveContainer" containerID="795f9bdd7cc465c6dfe53ace0225385b9a409aee597ce2e5b6c2f8b0ca88815a"
Oct 30 21:23:56.745957 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:56.745930    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"]
Oct 30 21:23:56.749321 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:56.749296    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-d8974d-7c7ccd46d8-kw4px"]
Oct 30 21:23:57.258927 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:57.258891    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06" path="/var/lib/kubelet/pods/0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06/volumes"
Oct 30 21:23:57.259291 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:57.259277    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="142f02fd-f2eb-46f7-b0bf-38061aa756df" path="/var/lib/kubelet/pods/142f02fd-f2eb-46f7-b0bf-38061aa756df/volumes"
Oct 30 21:23:57.259639 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:23:57.259627    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1bf0ea1-0290-4e3b-8594-3bb1afb659e0" path="/var/lib/kubelet/pods/b1bf0ea1-0290-4e3b-8594-3bb1afb659e0/volumes"
Oct 30 21:24:16.800805 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:24:16.800761    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:24:46.802205 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:24:46.802159    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:24:51.264471 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:24:51.264434    6048 scope.go:122] "RemoveContainer" containerID="2cf3019982c90c5b09acd24827d04eab168ad23a46876f77e3c2d4e6623f5158"
Oct 30 21:24:51.275178 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:24:51.275156    6048 scope.go:122] "RemoveContainer" containerID="10d19647bf2c41be61c709cfea96f1c0e3e202c8f421f468cd5e506e77761b42"
Oct 30 21:24:52.811858 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:24:52.811817    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c5b95d667-8hlfb_149e626e-7322-4454-8561-b174b7188894/authorino/0.log"
Oct 30 21:25:03.600434 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:03.600350    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-65c58bd4f6-5f68v_bbf23b33-ae8e-4619-a7a1-c91ab5f67309/manager/0.log"
Oct 30 21:25:03.795366 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:03.795335    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-s4pwv_295bb9fe-d414-4890-bc55-057f3fda2428/manager/0.log"
Oct 30 21:25:05.867585 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:05.867552    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5d4dc8d99b-f4bxl_7557a5bb-f8b7-4161-8d7f-d874b570b382/maas-api/0.log"
Oct 30 21:25:06.425456 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:06.425429    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-3e31a506-wrxdz_bff38ac2-e265-473a-80d3-0cd375b5353d/revoke-keys/0.log"
Oct 30 21:25:06.604773 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:06.604738    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-452b6d7b-xq4h2_850baea6-ac13-40bb-a0b8-59db3a4cb9f9/revoke-keys/0.log"
Oct 30 21:25:06.984672 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:06.984641    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-948e54d7-5h4rc_b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e/revoke-keys/0.log"
Oct 30 21:25:08.876119 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:08.876087    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c5b95d667-8hlfb_149e626e-7322-4454-8561-b174b7188894/authorino/0.log"
Oct 30 21:25:09.503133 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:09.503104    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-jdtlr_ff31bc45-f214-4fe4-a0b6-f22c60d6d998/kuadrant-console-plugin/0.log"
Oct 30 21:25:11.530367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:11.530328    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85bbc4c96f-gc4dr_f40ef661-ad7c-4d2d-8af1-01c99b180241/kube-auth-proxy/0.log"
Oct 30 21:25:11.896804 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:11.896767    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-77xqh_3a24703d-d12a-4443-b40f-7f00a4995d10/istio-proxy/0.log"
Oct 30 21:25:12.642226 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:12.642193    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-gddkd_794efeb8-0f81-4915-bbbd-80699907b7f9/istio-proxy/1.log"
Oct 30 21:25:13.221781 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:13.221743    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-q29bh_ad4e2a15-d67f-4ea2-b876-b9dc237497a3/istio-proxy/1.log"
Oct 30 21:25:15.104149 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:15.104120    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-gddkd_794efeb8-0f81-4915-bbbd-80699907b7f9/istio-proxy/0.log"
Oct 30 21:25:15.468073 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:15.467955    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-q29bh_ad4e2a15-d67f-4ea2-b876-b9dc237497a3/istio-proxy/0.log"
Oct 30 21:25:16.363992 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:16.363957    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-7cjqv_2e668cd9-0cf1-4ab4-94da-0e283fd10653/main/0.log"
Oct 30 21:25:16.541194 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:16.541150    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-67npv_22853c99-79a5-42c6-a102-a1a958194465/main/0.log"
Oct 30 21:25:16.803213 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:25:16.803126    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:25:16.914367 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:16.914335    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj_527d331c-7255-4a2a-be33-40a2c8a16b25/main/0.log"
Oct 30 21:25:17.474540 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:17.474506    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm_18730625-e6ba-421a-9a27-02acc29e9a2b/main/0.log"
Oct 30 21:25:18.377720 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:18.377684    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c5b95d667-8hlfb_149e626e-7322-4454-8561-b174b7188894/authorino/0.log"
Oct 30 21:25:27.819100 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:27.819066    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-65c58bd4f6-5f68v_bbf23b33-ae8e-4619-a7a1-c91ab5f67309/manager/0.log"
Oct 30 21:25:28.019377 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:28.019349    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-s4pwv_295bb9fe-d414-4890-bc55-057f3fda2428/manager/0.log"
Oct 30 21:25:29.023649 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:29.023614    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"]
Oct 30 21:25:29.026772 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:29.026746    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-452b6d7b-xq4h2"]
Oct 30 21:25:29.257951 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:29.257920    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="850baea6-ac13-40bb-a0b8-59db3a4cb9f9" path="/var/lib/kubelet/pods/850baea6-ac13-40bb-a0b8-59db3a4cb9f9/volumes"
Oct 30 21:25:29.784211 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:29.784184    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5d4dc8d99b-f4bxl_7557a5bb-f8b7-4161-8d7f-d874b570b382/maas-api/0.log"
Oct 30 21:25:30.342408 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:30.342380    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-3e31a506-wrxdz_bff38ac2-e265-473a-80d3-0cd375b5353d/revoke-keys/0.log"
Oct 30 21:25:30.690842 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:30.690748    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-948e54d7-5h4rc_b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e/revoke-keys/0.log"
Oct 30 21:25:33.211880 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:33.211848    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c5b95d667-8hlfb_149e626e-7322-4454-8561-b174b7188894/authorino/0.log"
Oct 30 21:25:33.829241 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:33.829213    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-jdtlr_ff31bc45-f214-4fe4-a0b6-f22c60d6d998/kuadrant-console-plugin/0.log"
Oct 30 21:25:35.601808 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:35.601775    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85bbc4c96f-gc4dr_f40ef661-ad7c-4d2d-8af1-01c99b180241/kube-auth-proxy/0.log"
Oct 30 21:25:35.988737 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:35.988636    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-77xqh_3a24703d-d12a-4443-b40f-7f00a4995d10/istio-proxy/0.log"
Oct 30 21:25:36.836301 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:36.836268    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-gddkd_794efeb8-0f81-4915-bbbd-80699907b7f9/istio-proxy/1.log"
Oct 30 21:25:37.391448 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:37.391415    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-q29bh_ad4e2a15-d67f-4ea2-b876-b9dc237497a3/istio-proxy/1.log"
Oct 30 21:25:39.035997 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:39.035966    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-7cjqv_2e668cd9-0cf1-4ab4-94da-0e283fd10653/main/0.log"
Oct 30 21:25:39.216860 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:39.216832    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-67npv_22853c99-79a5-42c6-a102-a1a958194465/main/0.log"
Oct 30 21:25:39.603736 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:39.603704    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b85gfdj_527d331c-7255-4a2a-be33-40a2c8a16b25/main/0.log"
Oct 30 21:25:40.172583 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:40.172555    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-6wsmm_18730625-e6ba-421a-9a27-02acc29e9a2b/main/0.log"
Oct 30 21:25:45.093309 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:45.093274    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"]
Oct 30 21:25:45.101336 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:45.101296    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3e31a506-wrxdz"]
Oct 30 21:25:45.257221 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:25:45.257187    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bff38ac2-e265-473a-80d3-0cd375b5353d" path="/var/lib/kubelet/pods/bff38ac2-e265-473a-80d3-0cd375b5353d/volumes"
Oct 30 21:25:46.801232 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:25:46.801196    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:26:06.023957 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:26:06.023913    6048 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"]
Oct 30 21:26:06.026370 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:26:06.026334    6048 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-948e54d7-5h4rc"]
Oct 30 21:26:07.259444 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:26:07.259406    6048 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e" path="/var/lib/kubelet/pods/b8a3b4c2-7c0e-4335-8c01-245f7eb7b20e/volumes"
Oct 30 21:26:16.800431 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:26:16.800391    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:26:46.801240 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:26:46.801202    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:26:51.316844 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:26:51.316810    6048 scope.go:122] "RemoveContainer" containerID="8db921357a6ea1689eae7d4c4fd3c2df71c6397318e14728ab7028bd4c97977f"
Oct 30 21:26:51.325475 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:26:51.325453    6048 scope.go:122] "RemoveContainer" containerID="b820f1fce08347bf5f5c581aa32dc54ddd83264443bf738a425cf375098d8d84"
Oct 30 21:27:11.176243 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:11.176213    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8p5hf_c28bc8e0-d670-4b43-bab5-d51bdbe1a350/global-pull-secret-syncer/0.log"
Oct 30 21:27:11.583511 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:11.583483    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lvlkq_c6ef821a-391c-4775-9cf4-f54b1a4d247d/konnectivity-agent/0.log"
Oct 30 21:27:11.680124 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:11.680093    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-162.us-east-2.compute.internal_079b2b48b74377f18062751235dbf291/haproxy/0.log"
Oct 30 21:27:16.802163 ip-10-0-131-162 kubenswrapper[6048]: E1030 21:27:16.802128    6048 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-44r9j" containerName="extractor"
Oct 30 21:27:18.520000 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:18.519962    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c5b95d667-8hlfb_149e626e-7322-4454-8561-b174b7188894/authorino/0.log"
Oct 30 21:27:18.624138 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:18.624110    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-jdtlr_ff31bc45-f214-4fe4-a0b6-f22c60d6d998/kuadrant-console-plugin/0.log"
Oct 30 21:27:20.034428 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.034401    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad485b24-958c-48d0-a14c-bcae7226371c/alertmanager/0.log"
Oct 30 21:27:20.073492 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.073468    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad485b24-958c-48d0-a14c-bcae7226371c/config-reloader/0.log"
Oct 30 21:27:20.106663 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.106630    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad485b24-958c-48d0-a14c-bcae7226371c/kube-rbac-proxy-web/0.log"
Oct 30 21:27:20.135969 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.135946    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad485b24-958c-48d0-a14c-bcae7226371c/kube-rbac-proxy/0.log"
Oct 30 21:27:20.165660 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.165639    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad485b24-958c-48d0-a14c-bcae7226371c/kube-rbac-proxy-metric/0.log"
Oct 30 21:27:20.199675 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.199656    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad485b24-958c-48d0-a14c-bcae7226371c/prom-label-proxy/0.log"
Oct 30 21:27:20.233355 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.233332    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ad485b24-958c-48d0-a14c-bcae7226371c/init-config-reloader/0.log"
Oct 30 21:27:20.328365 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.328331    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-vfn4t_a3510fa5-8b88-4b4d-893a-f3dca0163e72/kube-state-metrics/0.log"
Oct 30 21:27:20.351439 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.351412    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-vfn4t_a3510fa5-8b88-4b4d-893a-f3dca0163e72/kube-rbac-proxy-main/0.log"
Oct 30 21:27:20.380535 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.380508    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-vfn4t_a3510fa5-8b88-4b4d-893a-f3dca0163e72/kube-rbac-proxy-self/0.log"
Oct 30 21:27:20.411675 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.411645    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-59bcb84677-sjv66_664f00cf-cee9-45ed-9af7-52c78892a6dd/metrics-server/0.log"
Oct 30 21:27:20.441214 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.441190    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-pfxgr_18026b97-bf3c-49e4-8745-98869d8e1af2/monitoring-plugin/0.log"
Oct 30 21:27:20.719286 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.719193    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5lps_0ef23080-50af-4c4e-9cba-64a5c85fc4ac/node-exporter/0.log"
Oct 30 21:27:20.727773 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.727747    6048 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"]
Oct 30 21:27:20.728313 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.728294    6048 cpu_manager.go:414] "containerMap: removing container" podUID="142f02fd-f2eb-46f7-b0bf-38061aa756df" containerName="payload-pre-processing"
Oct 30 21:27:20.728429 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.728315    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="142f02fd-f2eb-46f7-b0bf-38061aa756df" containerName="payload-pre-processing"
Oct 30 21:27:20.728429 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.728341    6048 cpu_manager.go:414] "containerMap: removing container" podUID="0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06" containerName="payload-processing"
Oct 30 21:27:20.728429 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.728349    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06" containerName="payload-processing"
Oct 30 21:27:20.728429 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.728363    6048 cpu_manager.go:414] "containerMap: removing container" podUID="b1bf0ea1-0290-4e3b-8594-3bb1afb659e0" containerName="maas-api"
Oct 30 21:27:20.728429 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.728371    6048 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1bf0ea1-0290-4e3b-8594-3bb1afb659e0" containerName="maas-api"
Oct 30 21:27:20.728683 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.728492    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ad2abb5-3bc8-4ce8-8d00-2a7ddf72de06" containerName="payload-processing"
Oct 30 21:27:20.728683 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.728508    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1bf0ea1-0290-4e3b-8594-3bb1afb659e0" containerName="maas-api"
Oct 30 21:27:20.728683 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.728528    6048 memory_manager.go:365] "RemoveStaleState removing state" podUID="142f02fd-f2eb-46f7-b0bf-38061aa756df" containerName="payload-pre-processing"
Oct 30 21:27:20.731742 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.731723    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.737100 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.737080    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dwnkd\"/\"kube-root-ca.crt\""
Oct 30 21:27:20.737230 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.737150    6048 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dwnkd\"/\"openshift-service-ca.crt\""
Oct 30 21:27:20.739482 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.739465    6048 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dwnkd\"/\"default-dockercfg-h2dpm\""
Oct 30 21:27:20.754354 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.754320    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"]
Oct 30 21:27:20.766013 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.765990    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5lps_0ef23080-50af-4c4e-9cba-64a5c85fc4ac/kube-rbac-proxy/0.log"
Oct 30 21:27:20.795252 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.795230    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5lps_0ef23080-50af-4c4e-9cba-64a5c85fc4ac/init-textfile/0.log"
Oct 30 21:27:20.831820 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.831801    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-vvjwg_c6bd3b39-32fc-4092-a1ec-911f4a86bd7d/kube-rbac-proxy-main/0.log"
Oct 30 21:27:20.857704 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.857675    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-vvjwg_c6bd3b39-32fc-4092-a1ec-911f4a86bd7d/kube-rbac-proxy-self/0.log"
Oct 30 21:27:20.878512 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.878485    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff84d7a0-9de6-433c-91bd-6f582ce56235-sys\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.878596 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.878528    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff84d7a0-9de6-433c-91bd-6f582ce56235-podres\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.878637 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.878625    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff84d7a0-9de6-433c-91bd-6f582ce56235-proc\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.878677 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.878644    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtfh\" (UniqueName: \"kubernetes.io/projected/ff84d7a0-9de6-433c-91bd-6f582ce56235-kube-api-access-bqtfh\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.878677 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.878670    6048 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff84d7a0-9de6-433c-91bd-6f582ce56235-lib-modules\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.884165 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.884148    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-vvjwg_c6bd3b39-32fc-4092-a1ec-911f4a86bd7d/openshift-state-metrics/0.log"
Oct 30 21:27:20.946209 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.946170    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22efd4ff-977d-42a3-843a-f0f4a5acb4e6/prometheus/0.log"
Oct 30 21:27:20.973855 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.973765    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22efd4ff-977d-42a3-843a-f0f4a5acb4e6/config-reloader/0.log"
Oct 30 21:27:20.979473 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.979448    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff84d7a0-9de6-433c-91bd-6f582ce56235-sys\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.979585 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.979498    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff84d7a0-9de6-433c-91bd-6f582ce56235-podres\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.979585 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.979555    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff84d7a0-9de6-433c-91bd-6f582ce56235-proc\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.979585 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.979561    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff84d7a0-9de6-433c-91bd-6f582ce56235-sys\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.979585 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.979579    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtfh\" (UniqueName: \"kubernetes.io/projected/ff84d7a0-9de6-433c-91bd-6f582ce56235-kube-api-access-bqtfh\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.979826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.979610    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff84d7a0-9de6-433c-91bd-6f582ce56235-proc\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.979826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.979626    6048 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff84d7a0-9de6-433c-91bd-6f582ce56235-lib-modules\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.979826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.979640    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff84d7a0-9de6-433c-91bd-6f582ce56235-podres\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.979826 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.979695    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff84d7a0-9de6-433c-91bd-6f582ce56235-lib-modules\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:20.992144 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:20.992121    6048 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtfh\" (UniqueName: \"kubernetes.io/projected/ff84d7a0-9de6-433c-91bd-6f582ce56235-kube-api-access-bqtfh\") pod \"perf-node-gather-daemonset-x5cnp\" (UID: \"ff84d7a0-9de6-433c-91bd-6f582ce56235\") " pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:21.005275 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.005254    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22efd4ff-977d-42a3-843a-f0f4a5acb4e6/thanos-sidecar/0.log"
Oct 30 21:27:21.032727 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.032707    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22efd4ff-977d-42a3-843a-f0f4a5acb4e6/kube-rbac-proxy-web/0.log"
Oct 30 21:27:21.045087 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.045065    6048 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:21.060724 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.060698    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22efd4ff-977d-42a3-843a-f0f4a5acb4e6/kube-rbac-proxy/0.log"
Oct 30 21:27:21.088894 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.088868    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22efd4ff-977d-42a3-843a-f0f4a5acb4e6/kube-rbac-proxy-thanos/0.log"
Oct 30 21:27:21.132381 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.132356    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22efd4ff-977d-42a3-843a-f0f4a5acb4e6/init-config-reloader/0.log"
Oct 30 21:27:21.169081 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.169053    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-cdmsj_f81bbb61-4901-4f5b-91ec-ec15ae1fdc74/prometheus-operator/0.log"
Oct 30 21:27:21.192661 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.192636    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-cdmsj_f81bbb61-4901-4f5b-91ec-ec15ae1fdc74/kube-rbac-proxy/0.log"
Oct 30 21:27:21.260685 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.260615    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75d988bc69-vl9jp_9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/telemeter-client/0.log"
Oct 30 21:27:21.287737 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.287714    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75d988bc69-vl9jp_9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/reload/0.log"
Oct 30 21:27:21.319741 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.319713    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75d988bc69-vl9jp_9fd74d48-bbb1-4d0b-bf06-ff393896e8c3/kube-rbac-proxy/0.log"
Oct 30 21:27:21.321040 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.321002    6048 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"]
Oct 30 21:27:21.364066 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.364045    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96c4fbf99-4dtvx_e77e6b22-b7c0-4053-a277-baf7073c6b54/thanos-query/0.log"
Oct 30 21:27:21.391258 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.391236    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96c4fbf99-4dtvx_e77e6b22-b7c0-4053-a277-baf7073c6b54/kube-rbac-proxy-web/0.log"
Oct 30 21:27:21.419923 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.419890    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96c4fbf99-4dtvx_e77e6b22-b7c0-4053-a277-baf7073c6b54/kube-rbac-proxy/0.log"
Oct 30 21:27:21.445961 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.445930    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96c4fbf99-4dtvx_e77e6b22-b7c0-4053-a277-baf7073c6b54/prom-label-proxy/0.log"
Oct 30 21:27:21.474516 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.474498    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96c4fbf99-4dtvx_e77e6b22-b7c0-4053-a277-baf7073c6b54/kube-rbac-proxy-rules/0.log"
Oct 30 21:27:21.500867 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.500848    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-96c4fbf99-4dtvx_e77e6b22-b7c0-4053-a277-baf7073c6b54/kube-rbac-proxy-metrics/0.log"
Oct 30 21:27:21.834375 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.834333    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp" event={"ID":"ff84d7a0-9de6-433c-91bd-6f582ce56235","Type":"ContainerStarted","Data":"edce07d82d50df1508a7c894999a51389d5e0455967d03e645b537fbabe6ac13"}
Oct 30 21:27:21.834559 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.834398    6048 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp" event={"ID":"ff84d7a0-9de6-433c-91bd-6f582ce56235","Type":"ContainerStarted","Data":"3e108d219c8a420e3e3fe1bab63046f77d65c734a654221da9df54657b94be07"}
Oct 30 21:27:21.834559 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.834525    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:21.853972 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:21.853929    6048 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp" podStartSLOduration=1.853916637 podStartE2EDuration="1.853916637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:27:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:21.853194619 +0000 UTC m=+2852.711930926" watchObservedRunningTime="2026-10-30 21:27:21.853916637 +0000 UTC m=+2852.712652929"
Oct 30 21:27:25.714739 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:25.714705    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bd9vt_d26003df-46f0-4d7b-bd2c-b7fe898533cd/dns/0.log"
Oct 30 21:27:25.740559 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:25.740534    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bd9vt_d26003df-46f0-4d7b-bd2c-b7fe898533cd/kube-rbac-proxy/0.log"
Oct 30 21:27:25.937732 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:25.937701    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zv2n9_33b22c6f-4f13-4e54-9304-cfa57f52fbe1/dns-node-resolver/0.log"
Oct 30 21:27:26.636319 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:26.636287    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-45j6n_840bcd20-c702-4818-8e4e-0caa0ae2ffe3/node-ca/0.log"
Oct 30 21:27:27.850953 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:27.850923    6048 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dwnkd/perf-node-gather-daemonset-x5cnp"
Oct 30 21:27:30.253085 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:30.253055    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85bbc4c96f-gc4dr_f40ef661-ad7c-4d2d-8af1-01c99b180241/kube-auth-proxy/0.log"
Oct 30 21:27:30.353441 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:30.353413    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-77xqh_3a24703d-d12a-4443-b40f-7f00a4995d10/istio-proxy/0.log"
Oct 30 21:27:30.517561 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:30.517481    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-gddkd_794efeb8-0f81-4915-bbbd-80699907b7f9/istio-proxy/1.log"
Oct 30 21:27:30.517731 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:30.517639    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-gddkd_794efeb8-0f81-4915-bbbd-80699907b7f9/istio-proxy/0.log"
Oct 30 21:27:30.632196 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:30.632143    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-q29bh_ad4e2a15-d67f-4ea2-b876-b9dc237497a3/istio-proxy/1.log"
Oct 30 21:27:30.632526 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:30.632508    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-q29bh_ad4e2a15-d67f-4ea2-b876-b9dc237497a3/istio-proxy/0.log"
Oct 30 21:27:32.271479 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:32.271446    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wcfkv_06b08ffe-ca3b-4535-8563-567227a4af3e/serve-healthcheck-canary/0.log"
Oct 30 21:27:32.913875 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:32.913842    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44r9j_241b828d-8324-467d-9f6b-ab0c3959b895/kube-rbac-proxy/0.log"
Oct 30 21:27:32.946266 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:32.946237    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44r9j_241b828d-8324-467d-9f6b-ab0c3959b895/exporter/0.log"
Oct 30 21:27:32.974590 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:32.974566    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44r9j_241b828d-8324-467d-9f6b-ab0c3959b895/extractor/0.log"
Oct 30 21:27:33.565109 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:33.565079    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85bbc4c96f-gc4dr_f40ef661-ad7c-4d2d-8af1-01c99b180241/kube-auth-proxy/0.log"
Oct 30 21:27:33.607434 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:33.607403    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-77xqh_3a24703d-d12a-4443-b40f-7f00a4995d10/istio-proxy/0.log"
Oct 30 21:27:33.683394 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:33.683345    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-gddkd_794efeb8-0f81-4915-bbbd-80699907b7f9/istio-proxy/1.log"
Oct 30 21:27:33.683555 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:33.683516    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-gddkd_794efeb8-0f81-4915-bbbd-80699907b7f9/istio-proxy/0.log"
Oct 30 21:27:33.736428 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:33.736397    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-q29bh_ad4e2a15-d67f-4ea2-b876-b9dc237497a3/istio-proxy/1.log"
Oct 30 21:27:33.736605 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:33.736561    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-58c6585447-q29bh_ad4e2a15-d67f-4ea2-b876-b9dc237497a3/istio-proxy/0.log"
Oct 30 21:27:35.725442 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:35.725411    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5d46577d6f-8b72x_239248e2-6893-454d-b6ae-8cce8b00763d/manager/0.log"
Oct 30 21:27:35.751278 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:35.751248    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5d46577d6f-8b72x_239248e2-6893-454d-b6ae-8cce8b00763d/copy-manifests/0.log"
Oct 30 21:27:37.078871 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:37.078839    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-5588c9b996-gb4sz_fec53476-14d9-4d44-85b4-09582a1d8256/manager/0.log"
Oct 30 21:27:37.109917 ip-10-0-131-162 kubenswrapper[6048]: I1030 21:27:37.109887    6048 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-674cd59dc5-6lwvw_88552c39-f7f3-4bdc-be24-18fd0583312b/jobset-operator/0.log"